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j A parcunetric  integer  linear  program  (PILP)  may  be  defined  as  a 

I family  of  closely  related  integer  linear  programs  (ILP) . Within  this 

f definition  we  incorporate  not  only  continuous  scalar  parameterizations 

j 

i but  also  finite  paraime ter izat ions.  These  may  include  an  ILP  with  a 

I,  finite  number  of  objective  functions  or  right  hand  sides  or  constraint 

matrices  or  any  combination  of  thcs.:. 

I 

; A general  framework  for  PILP  is  presented.  It  begins  by  outlining 

? the  need  for  PILP  algorithms.  Basic  solution  methodologies  are  ex- 

I plained  and  two  rudimentary  approaches  for  the  PILP  are  stated.  The- 

■ oretical  properties  for  special  parameterizations  are  proved,  and 

techniques  for  improving  algorithmic  efficiency  are  discussed.  The 

framework  concludes  with  an  examination  of  uiiderlying  factors  which 

I. 

intimately  relate  to  the  scheduling  of  solution  priorities  in  a PILP 
algori thm. 

Three  special  PILP  problem  classes  are  studied  including  the  0-1 
knapsack,  generalized  assignment,  amd  capacitated  facility  location 
problems.  Algorithms  are  presented,  computational  results  are  cited, 
emd  conclusions  are  drawn  concerning  the  most  efficient  approaches. 
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As  a by-product  of  these  PILP  algorithms,  ef^'cient  algorithms  for  the 
corresponding  ILPs  in  each  problem  class  are  also  developed.  Finally, 
an  approach  for  the  general  PILP  is  proposed,  and  directions  for  future 


research  are  given. 
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INTRODUCTION 


A pareunetrlc  Inteijer  linear  program  (PILP)  may  be  defined  as  a 
family  of  closely  related  integer  linear  programs  (ILP) . Parcimetric 
linear  programming  (PLP)  theory  is  firmly  entrenched,  and  a parametric 
capability  is  provided  in  most  commercial  linear  pjogreunming  (LP) 
packages.  PILP,  on  the  other  hemd,  is  a virgin  field.  This  is  natural 
since  until  recently  methods  for  solving  ILPs  were  not  efficient. 

However  in  the  past  few  years  the  state-of-the-art  for  ILP  has  blossomed 
forth  to  such  an  extent  that  research  on  PILP  solution  techniques  may 
be  undertedcen  with  some  feeling  of  optimism. 

PLP  is  traditionally  thought  of  as  varying  a scalar  parcuneter 
continuously  over  a specified  range,  resulting  in  a continuum  of 
objective  functions  or  of  right  hand  sides  (resource  allocations) . 
However,  it  is  not  used  as  extensively  as  one  might  think.  This  is 
partly  due  to  the  fact  that  the  solution  output  generally  contains  much 
more  information  than  management  wants  or  needs,  and  partly  because 
very  small  changes  in  the  data  are  often  not  of  interest.  Rather, 
management  generally  desires  the  solution  to  a finite  number  of  revised 
models.  In  the  interest  of  solving  the  entire  collection  of  problems 
efficiently,  the  analyst  generally  uses  the  optimal  LP  basis  for  one 
problem  as  an  initial  basis  for  a revised  problem. 

Analogously,  while  continuous  parameterization  is  of  some  interest 
in  PILP,  the  definition  of  PILP  should  be  expanded  to  include  finite 
parcuneteri rations.  Specifically,  one  may  vary  a parameter  over  a fixed 
number  of  points  instead  of  over  a continuous  range.  This  results  in  a 
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finite  number  of  objective  functions  or  right  hand  sides.  An  excunple 
is  a capital  budgeting  problem  which  is  modeled  as  an  ILP.  Since  the 
precise  cost  of  capital  is  rarely  known  (genernlly  2m  educated  guess 
is  made) , a logical  approach  would  be  to  generate  em  objective  function 
for  each  cf  a series  of  estimated  costs  of  capital.  Using  this  finite 
set  of  objective  functions,  a finite  number  of  ILPs  (which  heretofore 
had  to  be  solved  independently)  is  trcmsformed  into  a PILP  with  a finite 
number  of  objective  functions.  Another  type  of  parameterization  which 
should  be  included  in  the  definition  is  varying  the  objective  function, 
the  right  hand  side,  emd/or  the  constraint  coefficients  simultemeously. 
Varying  the  constraint  coefficients  could  also  be  defined  to  include 
adding  or  deleting  variables  and  constraints.  PILP,  then,  may  be 
divided  into  three  brocd  categories: 

• parameterization  over  a finite  number  of  points  (including 
simultaneous  changes  in  the  objective  function,  right  hand 
side,  and  constraint  coefficients) 

• one  parameter  varied  continuously  over  a specified  -ange 

• two  or  more  parameters  varied  continuously  over  specified 
ranges . 

Due  to  the  increased  complexity  of  the  third  category  we  shall  address 
only  the  first  two. 

Mathematical  representations  of  parameterizations  for  the  two 
categories  to  be  addressed  are  given  below.  Let  x be  an  n-vector,  b 
am  m-vector,  and  A am  m^n  matrix. 


? 
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Finite  parameterization 


For  k « 1 , . . . , K solve : 

min  (c  + f.  )x 
k 

(A  + Dj^)x  > (b  + t^) 

Xj  integer,  j e J 

where  are  conformable  with  c,  A,  b respectively. 

Continuous  parameterizations 
For  V 0 e (0,1)  solve: 

min  (c  + 6f)x 
Ax  ^ b 

Xj  integer,  j £ J 
and  for  V 6 e [0,1]  solve: 

min  cx 

Ax  ^ b + 0r 
Xj  integer,  j e J 

where  f,  r are  conformable  with  c,  b respectively  and  where  0 is  a 
scalar.  Of  course,  in  the  finite  case  the  parameterization  may  be 
confined  to  only  the  objective  function,  or  the  right  hand  side,  or 
the  constraint  matrix. 

At  this  point  some  mention  should  be  made  of  work  which  has  already 
been  done  in  this  field.  It  appears  that  Rocdman  [1972,1973]  was  the 
first  to  do  any  computational  work  in  the  area.  Basically  he  has  devised 
a method  for  one-at -a-time  (e.g.,  one  cost  coefficient  or  one  reisource) 
sensitivity  emalysis  utilizing  the  fathomed  nodes  in  the  br£mch  and  bound 
tree  generated  for  the  ILP.  Bowman  [1974]  has  addressed  ILP  sensitivity 
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from  a group  theoretic  point  of  view.  However,  the  practicality  of  his 
method  has  not  yet  been  demonstrated.  Noltemeler  [1970]  has  done  some 
theoretical  work  in  the  area  of  ILP  sensitivity,  but  he  has  not  performed 
any  computational  studies.  Piper  and  Zoltners  [1973bl  have  attacked  the 
problem  of  solving  closely  related  ILPs  by  finding  a set  of  the  k best 
feasible  solutions  to  an  ILP.  Sufficiency  tests  are  proposed,  which  if 
passed,  assure  t^iat  ein  optimal  solution  to  a revised  ILP  remains  in  the 
set.  A recent  paper  by  Radke  [1974]  is  concerned  with  continuity  theory 
in  mixed  integer  programming.  While  it  is  essentially  a theoretical 
treatise,  it  does  prescribe  methods  for  eliminating  the  bogey  of  dis- 
continuity in  some  problems. 

The  plan  of  the  paper  is  as  follows.  In  the  remainder  of  this 
chapter  the  lotivation  for  studying  PILP  is  outlined  by  presenting  types 
of  analysis  t*--  which  a PILP  formulation  may  be  effective.  Basic 
solution  method*. Vnies  for  PILP  are  presented,  and  two  rudimentary 
algorithms  are  givm.  Characteristics  and  properties  of  special 
parameterizations  are  given  in  chapter  II,  emd  in  chapter  III  problem 
dependent  techniques  for  iitproving  algorithmic  performance  are  set  forth. 
Factors  affecting  the  scheduling  of  solution  priorities  for  the  PILP  are 
examined  in  chapter  IV,  and  three  different  priority  schemes  are  pre- 
sented. In  chapters  V,  VI,  and  VII  the  ideas  and  results  of  chapters 
II-IV  are  applied  to  special  problem  classes  including  the  0-1  knapsack 
problem,  the  generalized  assignment  problem,  and  the  capacitated  facility 
location  problem.  Algorithms  are  stated,  computational  results  cited. 


and  conclusions  drawn  concerning  the  most  efficient  algorithms  for  each 
problem  class.  Finally  in  chapter  VIII  an  approach  for  the  general  PILP 
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Is  proposed,  wd  directions  for  future  research  are  given. 

We  advise  the  reader  that  problem  notations  remain  valid  for 
individual  chapters  only. 

A.  The  Need  for  PILP  Algorithms 

Oftentimes  in  practical  ILP  applications,  finding  aii  "optimal" 
solution  to  a model  is  not  the  only  requirement.  Managers  may  also  be 
interested  in  solutions  which  are  close  to  optimal,  or  they  may  want  to 
know  what  happens  if  a certain  change  is  made  in  the  model.  Some  cost 
coefficients  or  right  hand  sides  may  not  be  known  with  certainty,  and 
hence  the  manager  must  know  how  the  optimal  solution  behaves  as  these 
parameters  are  varied  in  the  model.  Rarely,  then,  is  an  optimal  solution 
sufficient  for  the  needs  of  management.  In  most  applications  various 
types  of  analysis  must  be  done,  and  many  of  them  can  be  classified  under 
the  broad  term,  PILP.  This  is  because  they  satisfy  the  criteria  of 
being  a family  of  closely  related  ILPs.  Quite  a few  types  of  analysis 
are  mentioned  in  Geoffrion  [1974a].  These  along  with  some  others  are 
given  below. 

• Sensitivity  analysis;  When  probleiu  data  in  an  ILP  is  not  known  pre- 
cisely, point  estimates  must  be  used  in  the  model.  Varying  this  data 
over  a range  of  estimates  allows  management  to  determine  how  sensitive 
an  optimal  solution  cind  value  are  to  cheinges  in  the  data. 

• Shadow  price  analysis;  In  every  linear  programming  solution,  shadow 
prices  are  available  from  the  final  tableau.  These  prices  reflect  the 
vcdue  of  an  extra  unit  of  resource.  Unfortunately,  reliable  shadow 
prices  are  not  aveiiladsle  in  ILP.  By  varying  a right  hand  side  coeffi- 
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dent  and  observing  how  the  optimal  value  changes,  it  is  possible  to 
get  an  approximation  of  the  value  of  an  e vtra  unit  of  a particular 
resource. 

• Tradeoff  ^ulalyBi8!  When  two  or  more  criteria  are  reflected  in  a 
model,  management  must  know  the  tradeoffs  involved  in  balaicing  one 
criteria  against  another.  For  example,  a tradeoff  curve  between 
customer  service  and  total  cost  in  a distribution  system  depicts  how  a 
change  in  customer  service  affects  total  distribution  cost.  Such  an 
analysis  would  be  done  by  varying  the  customer  service  parameters  in 
the  model  over  a suitable  r^mge. 

• Continuity  ^ulaly3i8  [Radke  1974]:  In  linear  programming,  continuity 
of  the  optimal  solution  value  with  respect  to  problem  data  is  generally 
taken  for  granted.  In  integer  programming,  however,  serious  disconti- 
nuities are  more  likely  to  occur.  The  analyst  is  interested  in  finding 
sufficient  conditions  for  which  continuity  holds.  Failing  this,  he 
would  like  to  identify  points  of  serious  discontinuity.  If  a disconti- 
nuity exists  and  it  is  an  accurate  representation  of  the  real  world 
system,  he  may  want  to  alter  the  problem  data  in  order  to  improve  the 
objective  value.  If  it  is  not  an  accurate  representation,  a reformula- 
tion of  the  model  may  be  required  so  that  it  more  accurately  represents 
the  real  world  system.  The  task  of  identifying  discontinuities  or 
verifying  that  there  are  none  in  the  region  of  interest  can  often  be 
accomplished  by  systematically  varying  problem  data  over  some  neighbor- 
hood. Thus  a number  of  closely  related  problems  may  be  fon:iulated  as 

a PILP. 

• Contingency  analysis;  ILP  models  must  make  specific  assumptions. 


6 


- 


Basi'-  Methodologies  for  Solving  the  PILP 


It  is  natural  to  look  to  ILP  solution  methodology  for  ideas  on  form- 
ulating a solution  methodology  for  PILP.  ILP  solu  .ion  techniques  tend 
to  fall  into  three  distinct  categories:  cutting  plane,  group  thaory, 
and  b'anch  emd  bound.  Garfinkel  and  Nemhauser  [1972]  give  a detailed 
account  of  each  of  these  categories. 

With  one  notable  exception  (Martin  [1963]),  cutting  plane  techniques 
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have  not  been  overly  successful  in  practice.  Since  cutting  plane  methods 
are  dual  based,  no  feasible  solutions  are  generated  along  the  way  to 
finding  an  optimal  solution.  This  is  a serious  drawback  since  even 
though  finite  convergence  is  assured  for  many  cutting  plane  algorithms, 
no  upper  bound  cw  be  put  on  the  number  of  iterations  required  to  find 
an  optl'  am.  This  lack  of  an  upper  bound  on  the  convergence  of  the 
algorithms,  coupled  with  the  inability  to  systematically  generate 
feasible  solutions,  generadly  makes  cutting  plane  methods  unattractive 
in  real  world  ILP  applications. 

Group  theoretic  methods  have  been  applied  to  pure  ILPs  for  the  most 
part.  While  some  advances  have  been  made,  computational  experience  has 
shown  that  group  methods  are  not  as  effective  as  the  branch  emd  bound 
approach,  although  they  may  be  useful  within  a branch  and  bound 
framevrork. 

Brwch  emd  bound  methodology  has  come  to  the  fore  in  ILP  techi.ology. 
Due  to  the  inherent  flexibility  of  this  approach,  problems  with  special 
structure  ceui  be  solved  efficiently  by  testing  advantage  of  properties 
associated  with  the  special  structure.  Furthermore,  feasible  solutions 
eu:e  often  generated  before  optimality  is  proved  so  that  if  early  termina- 
tion is  necessary,  a good  feasible  solution  will  be  available  in  most 
cases . 

In  the  remainder  of  this  chapter  some  PILP  analysis  will  be  devel- 
oped using  cutting  plane  methods.  However,  as  would  seem  to  be  tme  in 
ILP,  the  most  effective  use  of  cutting  plemes  appears  to  be  incorporating 
them  in  a breuich  and  bound  approach.  The  bulk  of  the  analysis  conse- 
quently will  be  am  outgrowth  of  ILP  breuich  and  bound  methodology. 


As  a means  for  understauidlng  the  relationship  between  ILP  and  PILP 
solution  techniques,  two  rudimentary  algorithms  for  solving  a PILP  will 
be  given.  The  first  approach  utilizes  cutting  planes  while  the  second 
uses  branch  and  bound.  These  algoritlims  should  provide  a springboard 
for  the  more  detailed  analysis  in  Inter  chapters. 


1.  Cutting  Plane  Approach 


Thv  main  idea  behind  cutting  plane  algorithms  in  ILP  is  to  "cut  off" 
portlonr;  of  the  linear  programming  feasible  region  while  leaving  the  ILP 
feasible  region  'l-e.,  the  convex  hull)  untouched.  The  optimal  linear 
programming  solution  hus  approaches  the  optimal  integer  solution  as  the 
LP  feeisible  region  approaches  that  of  the  ILP  feasible  region.  Conputa- 
tional  experience  has  shown  that  the  first  few  cuts  are  often  very 
effective  in  removing  large  parts  of  the  LP  feasible  region.  However, 
later  cuts  tend  to  become  more  and  more  degenerate,  and  progress  toward 
an  optimal  ILP  solution  deteriorates. 

This  enpirical  property  of  cutting  plane  algorithms  might  be  ex- 
ploited in  PILP.  Assume  we  have  a PILP  with  a finite  number  of  objective 
functions : 

For  k » 1,...,K  solve: 


min  (c  + f,  )x 
x>0  “ 


Ax  > b 


Xj  integer,  j e J 


where  c,  f , A,  b are  all  integer  valued.  It  is  easy  to  see  that  the 


feasible  regions  of  each  (Rj^)  are  the  same.  If  cuts  are  made  only  on 


the  constraint  set,  then  a cut  which  is  valid  for  (R^)  , say,  is  valid 
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for  all  other  (I^) . Of  course,  a cut  made  on  the  objective  function  may 
not  be  valid  for  all  (I^) . Therefore  we  assume  in  the  following  that 
such  cuts  are  not  allowed. 

Since  cutting  plane  algorithms  usually  perform  well  during  the  first 
few  iterations,  a plausible  approach  for  solving  the  PILP  might  be  the 
following.  We  assume  the  feasible  region  is  nonempty  and  .bounded. 


Solve  (R^)  to  LP  optimality.  If  the  optimal  solution  is  not  Integer 


feasible,  then  cuts  are  added  to  (R^)  until  they  become  "ineffective", 


euid  then  retaining  these  cuts,  (R^)  is  solved  to  LP  optimality.  Cuts 


are  then  added  to  (R^)  until  they  become  ineffective,  and  (R^)  is  then 


solved  to  LP  optimality,  etc.  When  cuts  become  ineffective  for  (R^) 


return  to  (R^)  and  continue  the  process.  The  hope  is  that  cuts  added 


to  one  problem  will  eliminate  the  long  series  of  ineffective  cuts  for 
the  other  problems. 

A cutting  plane  2dgorithm  for  the  PILP  with  a finite  number  of 
right  hand  sides  ceui  also  be  constructed.  Consider  the  problem: 

For  k ■ 1, . . . ,K  solve: 


min  cx 
x>0 


Ax  > b + r. 


Xj  integer,  j e J . 


In  the  general  case  some  constraints  are  being  tightened  £uid  others  are 
being  rel2uced  as  k varies,  so  that  the  feasible  regions  are  not  neces- 
sarily of  the  form  F(Q  ) ^F{Q  ) p...  pF(Q„.)*  Up  until  now  it  was 
thought  that  cutting  planes  cotild  not  be  used  under  such  conditions , 


since  a cut  might  be  valid  for  one  (Q^^)  but  not  for  another.  The  fol- 


lowing new  result  allows  one  to  generate  a valid  cut  for  all  K problems. 
In  the  theorem  we  shall  use  the  traditional  LP  notation  of  the 
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simplex  method.  Let  B be  a basis,  be  a basic  variable  under  the 

i 


basis  B,  NB  be  the  index  set  of  nonbasic  variaJsles,  and  x ” y,  - 

-1  - ‘ 

I where  y.  ■ (fl  b).,  and  a is  the  updated  constraint  coef- 

jeNB  J ^ ^ 


ficient  for  the  LP  tableau  associated  with  the  basis  B.  We  assume  that 


(Q  ) is  a pure  integer  program  with  c,  r , A,  b having  all  integer 
^ K 


components  for  k An  analogous  result  holds  for  the  mixed 


integer  case  as  well. 


Theorem  1.  Given  any  basic  (possibly  primal  infeasible)  solution  for 


(Q,  ) , the  traditional  Gomory  cut,  I (a.^  - Ia.,))x.  > y.  - [y  1 


(using  the  i row  of  the  tableau  as  the  source  row)  , does  not  violate 


the  convex  hall  of  integer  solutions  for  (Q^^) . 


Proof;  Let  be  a basic  variable  and  suppose  y^  < 0.  Then  x^  - y^ 

Z a x x + E (a  )x  < y since  x ^ 0 V j e NB  «•  x + 
jSNB  J ®i  jcNB  3 i 3 


E a x x + E (a.Jx  < y since  x ^ 0 V j e NB  «•  x + 
jSNB  J ®i  jcNB  13  3 i 3 

E [a.  .]x,  £ [y.l  since  both  sides  of  the  inequality  must  be  integer. 
jeNB  J ^ 

Then 


x„  + E a. .X.  = y. 

B.  . _ 11  I 1 

1 jeNB  ■'  ■' 


(x  + E [a.  Jx.  < (y.  ] ) 
®i  JCNB  >53-* 


E (a. . - (a. ,J)x,  > y,  - (y. ] 
jeNB  13  D - 1 


or  letting  f . , »=  a.  . - (a.  .]  and  f.  = y,  - (y.J  , 
i]  1]  ij  1 1 1 


we  have  I f . ,x.  > f . . 

jcRB  3 - ’• 


Note  that  the  assumption  that  y^  < 0 did  not  affect  the  proof. 


In  order  to  use  this  result  effectively,  we  proceed  as  follows. 


Set  the  LP  tableau  for  an  initial  basic  feasible  solution  for  (Q^) 
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under  the  basis  B, 


where  y is  the  updated  right  hand  side  2uid  z is  the  associated  objec- 

IZA 


tive  function  value.  Then  in  columns  directly  to  the  left  of  the 


column,  add  columns  for  initial  (possibly  infeasible)  basic  solutions 
for  (Qjj)  * ^ ■ 2,...,K  with  respect  to  the  initial  basis  B found  for  (Q^^) 


"k 

• • • 

*2 

^1 

K 

2 

1 

^i 

1 

1 

• • • 

^i 

^i 

(Q^)  •••  (Q2) 


Now  solve  the  LP  for  (Q^^)  updating  the  tableau  from  iteration  to 
iteration  in  the  usual  manner  with  the  extra  columns  for  k = 2,...,K 
being  updated  according  to  the  same  rules  as  for  k * 1.  Assume  we  have 


solved  the  LP  to  optimality  for  (Q^)  and  the  solution  is  not  integer. 


Then  we  may  add  the  cut  (choosing  a source  row  i)  : 


jeNB 


f . .X.  > f , . 

1]  ] - 1 


But  by  Theorem  1 we  may  add  the  cut  E the  same 

jeNB  ^ 

source  row)  for  (Q.  ) , k • 2,...,K.  Note  that  E f.  .x  is  the  same  for 
^ jeNB  ^ J 
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•11  k,  so  that  only  one  row  must  be  added  to  the  tableau.  This  row 

12  K 

will  be  E ^4^*4  — (f , j * • • • j ) . The  expanded  tableau  is; 

jeNB  J ‘ ^ ^ 


. . . 

"2 

*1 

K 

. . . 

2 

^i 

1 

^i 

f*^ 

1 

. . . 

1 

f2 

1 

f' 

1 

f.  . 

1-3 

(Q^)  ...  (Q2)  (Q{> 


So  then  for  any  ' isis  B we  may  add  a cut  which  is  valid  for  each  (Q^) . 
Unfortunately/  a cut  guarantees  only  to  cut  off  the  current  solution/ 
and  not  to  cut  off  emy  feasible  integer  solutions.  So  if  the  current 
basic  solution  is  infeasible  for  some  (Q^)  , it  is  possible  that  non* 
of  the  feasible  LP  region  of  (Q^^)  will  be  cut  off.  However,  if  the 
current  infeasible  solution  is  "close"  to  the  feasible  region,  it  is 
more  likely  that  some  of  the  feasible  LP  region  will  be  cut  off. 

It  follows  that  the  cutting  pleine  approach  given  for  the  finite 
objective  function  PILP  can  be  used  also  for  this  finite  right  hand 
side  PILP  assuming  that  for  each  (Q^^)  the  feasible  region  is  nonempty 
and  bounded.  By  making  simple  changes  to  allow  for  unbounded  or  enpty 
feasible  regions,  this  assumption  may  be  dropped. 
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2.  Branch  and  Bound  Approach 


We  now  turn  our  attention  to  the  method  of  branch  and  bound.  Due 
to  the  Inherent  flexibility  of  the  approach,  it  is  no  surprise  that  the 
general  ILP  branch  2md  bound  approach  may  be  extended  in  a stralght- 
foivard  manner  to  the  PILP.  We  shall  give  a rudimentary  ILP  algorithm 


and  then  show  now  it  can  be  generalized  to  the  PILP. 


Consider  the  ILP: 


min  cx 


Ax  > b 


Xj  integer,  j e J • 

Let  v(*)  be  the  optimal  value  of  (•)•  A rudimentary  branch  and  bound 
approach  for  (P)  is  (Geoffrion  ard  Karsten  [1972]): 

1.  Initialize  the  candidate  list  to  consist  of  (P)  and  set  z*  to  “. 

2.  Stop  if  the  candidate  list  is  empty:  if  z*  is  finite,  then  the 
solution  X*  associated  with  z*  is  optimal  in  (P) ; otherwise  (P) 
has  no  feasible  solution. 

3.  Select  one  of  the  candidate  problems  to  become  the  current 
candidate  problem  (CP) . 

4.  Solve  a relaxation  of  (CP)  , namely  (CP^^) . 

5.  If  F(CP  ) = 0 or  v(CP  ) _^z*,  then  go  to  2. 

6.  If  the  optimal  solution  to  (CP  ) is  integer  feasible,  set  z*  = 

R 

v(CP_),  set  X*  to  the  optimal  solution  of  (CP  ) , and  go  to  2. 

R R 

7.  Separate  (CP)  into  two  simpler  problems  such  that  the  union  of 
their  feasible  regions  is  the  feasible  region  of  (CP)  . Add  these 
two  problems  to  the  c^uldidate  list  eind  go  to  3. 
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We  now  consider  the  PILP. 
For  k > 1,...,K  solve: 


min  <c  + f,  ) X 
k 

(A  + Dj^)x  ^ b + 

Xj  integer,  j e J . 


Candidate  problems  will  be  denoted  by  (P  ) . The  subscript  k refers 

]c  * R • 

1 

to  the  particular  problem  in  the  PILP,  while  refers  to  a particular 
restriction  placed  on  (Pj^)  as  a result  of  separation.  An  exan^le  of  such 
a restriction  would  b<j  to  append  the  constraint  = 1 to  (Pj^)  . Define 
R-  to  be  the  null  restriction,  so  that  (P,  _ ) * (P.)  V k ■ 1,...,K. 

u iC , Rq  k 

A rxidimentary  br^ulch  and  bound  approach  for  the  PILP  is; 


1.  Initialize  the  candidate  list  to  consist  of  (P  ) , (P-  _ ),..., 

I > Rq  ^ » Rq 

(P  ) end  set  z*  to  ® for  k = 1,...,K. 

K,  Rq  K 


2.  Stop  if  the  c^mdidate  list  is  empty:  for  each  k = 1,...,K,  if  z* 
is  finite,  then  x*  is  optimal  in  (P.  ) ; otherwise  (P  ) has  no 

K K 

feasible  solution. 

3.  Select  some  subset,  S,  of  the  candidate  list  such  that  each  member 

of  S has  the  same  R^.  For  s e S denote  the  corresponding  candidate 

problem  by  (CP  ) . 

K f S 

4.  For  each  s e S,  solve  a relcixation,  say,  (CP  ) , of  (CP  ) . 

R^  S K ^ 

5.  For  each  s e S,  if  either  F(CP,  ) = (J  or  v((CP,  ) ) > z*,  then 

k , R^  s k , s — k 

delete  s from  S.  It  S is  empty,  go  to  2. 

6.  For  each  s e S,  if  an  optimal  solution  to  (CP  ) is  integer 

K t S 

feasible,  set  z*  = v(  (CP,  „ ) ) and  x,*  to  the  optimal  solution  of 
k k,R.  s k 

1 

(CP,  „ ) and  delete  s from  S.  If  S is  empty,  go  to  2. 
k , R.  s 
1 

7.  For  each  s e S,  separate  (CP  ) into  two  simpler  problems  such 

K ^ R . S 
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that  the  union  of  the  feasible  regions  is  the  feasible  region  of 
(CP.  - ) « Update  R.  to  reflect  this  added  restriction,  and 

K f S i 

go  to  3. 

Through  the  choice  of  the  subset  S of  candidate  problems  in  step 

3,  flexibility  is  permitted  in  determining  the  order  (if  auiy)  in  which 

the  individual  (Pjj)'s  are  to  be  solved.  By  restricting  the  choice  of 

S to  those  candidate  problems  with  the  same  , it  may  be  possible  to 

utilize  parametric  reoptimization  techniques  in  step  4.  This  is  the 

main  reason  for  allowing  more  thain  one  candidate  problem  at  a time  to 

be  selected  from  the  candidate  list  ir.  step  3.  In  steps  5 and  6 if 

fathoming  occurs  for  some  s e S,  then  s may  be  deleted  from  S since  any 

further  restrictions  of  (CP.  „ ) are  not  of  interest.  In  step  7 

k,R.  s 
1 

separation  occurs  for  all  remaining  s c S.  In  order  to  capitalize 
fully  on  parametric  reoptimization  techniques  in  step  4,  it  may  be 
advisable  to  invoke  identical  separations  for  all  s e S.  However  this 
is  not  required.  Basically,  then,  the  choice  of  S in  step  3 and  the 
choice  of  relaxation  in  step  4 allows  fathoming  euid  separation  machinery 
to  be  applied  in  such  a way  as  to  limit  the  number  of  releucations  to  be 
solved  and  to  have  control  over  the  creation  of  new  ccuididate  problems. 

Armed  with  these  rudimentary  approaches  for  PILP  our  next  task  is 
to  identify  and  catalog  salient  characteristics  and  properties  of 
special  types  of  parameterizations  which  may  be  of  use  in  formulating 
more  sophisticated  algorithms.  This  is  the  topic  of  the  next  chapter. 
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II.  CHAIUCTERISTICS  AND  PROPERTIES  OF  PARTICULAR  PARAMETERIZATIONS 

Aside  from  characteristics  of  specific  problem  classes,  a PILP 
possesses  other  characteristics  and  properties  which  may  Influence  the 
solution  strategies  to  be  used  in  eui  efficient  algorithm.  Ibese 
attributes  generally  depend  on  the  type  of  2uialysls  which  is  being 
undertaken,  e.g.,  tradeoff,  sensitivity,  priority,  etc.  A representative 
checklist  of  attributes  is: 

• Are  2dl  the  ILP  problems  which  meike  up  the  PILP  known  in  advmce? 
An  example  of  where  this  may  not  be  the  case  is  in  a priority 
analysis.  This  analysis  depends  in  a sequential  fashion  on  the 
optimal  solutions  to  selected  ILPs;  generally  it  is  in^ssible  to 
state  explicitly  in  advance  all  of  the  ILPs  which  are  to  be  solved. 

• How  mamy  ILP  problems  make  up  the  PILP?  Are  there  just  a few, 
a dozen,  a continuum,  or  is  the  number  unknown? 

• How  au:e  the  individual  ILP  problems  related  to  one  another? 

Do  they  differ  only  in  the  objective  function  or  only  in  the 
right  hand  side?  Does  the  constraint  matrix  change?  Are 
variables  added  or  deleted?  Are  constraints  added  or  deleted? 

Is  there  a continuous  parameter  of  change?  Are  the  feasible 
regions  or  the  objective  functions  changing  monotoneiy? 

• What  optimality  tolerance  is  required?  Is  e -optimality  or 
"beating  some  threshold"  the  criterion?  Is  the  threshold  value 
known  in  advc'.''e  for  each  problem  or  does  it  depend  on  inter- 
mediate solution  results? 

Associated  with  some  of  these  attributes  are  properties  which  may 
be  used  to  advantage  in  algorithmic  design.  Some  of  these  properties 
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allow  the  tremsfomatlon  of  a given  PILP  into  a hopefully  simpler  PILP. 
Otherr  deal  with  the  behavior  of  the  optimal  solution  and  value  for 
special  types  of  parameterlzatlons. 


A.  Transformation  of  a Continuous  Pure  PILP  to  a Finite  PJLP 


Consider  the  pure  Integer  PILP: 

For  V 0 e [0,1]  solve: 

min  cx 

(Tg)  Ax  ^ b + er 

X integer 

where  x Is  an  n-vector  and  b Is  an  m-vector.  We  assume  that  each 
component  of  c,  b,  r,  and  each  entry  of  A is  integer  valued,  rrtie  ele- 
mentary result  which  follows  (cf.  Noltemeier  [1970])  shows  that  it  is 
possible  to  transform  the  continuum  of  problems  over  V 0 e [0,1]  into 
an  equivedent  PILP  with  a finite  number  of  right  hand  sides. 


Theorem  2.  The  PILP,  (T„)  V 0 e [0,1],  may  be  transformed  into  an 

--  . _ . 0 

equivalent  PILP  of  the  form: 

For  k ■ 1,...,K  solve: 

min  cx 

(T,  ) Ax  > b + t, 

X integer 

where  tj^  is  an  integer  valued  vector  conformable  with  b for  k = 1,...  ,K. 
Proof:  Since  all  entries  are  integer  and  x is  required  to  be  integer, 

A A 

then  for  a given  0 e [0,1]  the  vector  b + 0r  may  be  replaced  by  the 
vector  <b  + 0r>  (where  <•>  denotes  the  smallest  integer  greater  than  or 
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•qual  to  ',  component  by  component).  It  follows  that  it  is  sufficient 
to  solve  the  PILP  for  those  6 e [0,1]  such  that  6r^  is  integer  (r^  jt  0) 

for  some  i c {l,...,m}.  But  only  a finite  number  of  values  of  6 e [0,1] 

satisfy  this  property,  since  each  component  of  r is  finite.  Hence  the 
PILP  may  be  transformed  to  the  problem  in  the  theorem  statement.  | ( 
The  actual  transformation  may  be  done  in  the  following  way.  For 
each  component  r.  y 0 of  r write  down  the  values  of  6 c [0,1]  for 

' 1 2 IVM 

which  r.  is  an  integer.  These  values  are  0,  i — r,  i i , ...,  i i , 1. 

Place  these  values  in  a set  R. . Then  H « U R.  is  the  set  of  values 

^ i-1  ^ 

of  6 for  which  some  Sr^  is  integer.  Let  K be  the  cardinality  of  H, 
and  let  6j^  be  an  element  of  H.  Then  aui  equivalent  PILP  is; 

For  k ■ 1,...,K  solve: 

min  cx 

Ax  > b + 0.  r 
— k 

X integer  . 

Letting  t^^  ■ 9j^r  we  have  the  result  staled  in  the  theorem. 

B . Theoretical  Properties  for  Right  Hand  Side  and  Constraint  Matrix 
Parameterl rations 


Consider  the  PILP: 
For  k - 1,...,K  solve: 


min  cx 


(a  + D )x  > b + r, 
k — k 

x^  integer,  j e J . 


Note  that  this  parameterization  allows  simultemeous  chauiges  in  the 


constraint  matrix  and  the  right  hand  side.  Let  F(Sj^)  be  the  respective 
feasible  regions,  v(S|^)  be  the  optimal  solution  values,  emd  x*  be  em 
optimal  solution  for  (S^^) . 
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D«finition»  A PILP  ii  said  to  ba  monotone  if  F(Sj^)  2 

Theorem  3.  Let  the  PILP  be  monotone.  If  is  optimal  for  (S^^)  and 
X*  c *k  optimal  for  also. 

Proof;  Since  ’‘k  ^ 

v(Sj^^j^)  - v(Sj^)  and  x*  is  optimal  for  • II 

It  is  clear  that  if  a PILP  (or  even  some  subset  of  the  PILP)  is 
monotone,  and  the  individual  problems  are  solved  in  the  order  of 
decreasing  feasible  regions,  then  some  (S^^)  may  not  have  to  be  solved. 
This  occurs  if  xjj  e 

We  mention  in  passing  that  a well-known  PLP  result  for  a contin- 
uous par^uneterization  of  the  right  hand  side  does  not  hold  for  PILP. 
Consider  the  PLP; 

For  V 0 c [0,1]  solve; 


(H,) 


min  cx 
xcx 

Ax  > b + 0r 


where  X is  a polyhedral  containing  upper  and  lower  bounds  on  all 
variables,  thus  assuring  a bounded  feasible  region.  It  is  well-known 
that  the  optimal  solution  value  v(H„)  is  piecewise  linear,  contintx^us, 
and  convex.  Unfortunately,  this  does  not  hold  for  the  corresponding 
PILP.  However,  we  do  have  the  following  simple  result. 

Consider  the  PILP: 

For  V 0 E [0,1]  solve; 


<“6> 


min  cx 
xcX 

Ax  > b + 0r 


Xj  integer,  j e J . 
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Let  the  PILP  be  monotone.  That  is,  if  0 ^ 0^  ^ 0^  ^ 1,  then 

F(H-  ) 2 ).  Also  assume  that  F(H  ) ft  (3. 

1 2 ^ 

Theorem  4.  The  optimal  solution  value  v(H„)  is  nondecreaslnq  (and 

u 

hence  quasiconvex)  on  [0,1]. 

Proof ; Immediate.  | | 

Note  that  v(H  ) will  be  piecewise  linear  and  convex  over  segments 
of  [0,1],  but  that,  in  general,  dis con cinui ties  will  occur  at  isolated 
poinU.  on  [0,1]  . 

C . Theoretical  Properties  for  Objective  Function  Parameterizations 

When  compared  with  the  paucity  of  results  for  right  h£md  side 
parameterizations,  the  quantity  of  results  for  objective  function 
parameterizations  itusy  come  as  some  surprise.  This  is  due  to  the  con- 
stancy of  the  feasible  region  as  a function  of  the  parameterization. 
All  of  the  results  in  this  section  deal  with  the  behavior  of  the  opti- 
mal solution  auid  value  as  a function  of  the  parameterization. 

Consider  the  PILP; 

For  V 0 e [0,1]  solve; 


min  (c  + 6f)x 
xcX 

Ax  ^ b 

Xj  integer,  j e J 


where  X is  a compact  polytope.  The  following  result  (Manne  [1967]  and 
Noltemeier  [1970])  is  a direct  extension  of  the  result  for  the  corres- 
ponding PLP  problem. 
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Theorem  5.  For  (P^)  V 0 e [0,1]  the  optimal  solution  value  v(Pg)  is 
piecewise  linear,  continuous,  and  concave. 


Proof ; Let  F ■ {x  |x  c X,  Ax  2.  ^3,  ^uld  x^  integer,  j e j}.  Replace  F by 
its  convex  hull,  Co(F).  It  is  well-kno%m  that  this  can  be  accomplished 
by  adding  a finite  number  of  linear  constraints  to  the  problem.  The 
ccxivex  hull  has  the  property  that  each  of  it-i  extreme  points  corre- 
sponds to  a feasible  solution  of  F.  But,  for  V 6 c [0,1]: 

min  (c  + 0f)x  is  just  a PLP.  Then  since  the  optimal  solution 
xcCo(F) 

value  of  a PLP  over  6 is  piecewise  lineeur,  continuous,  and  concave,  it 
must  also  be  such  for  the  PILP.  | | 

This  result,  when  coupled  with  the  next  theorem,  reduces  the 
continuxsn  of  problems  (Pg)  V 6 e [0,1]  to  a finite  number  of  problems 
for  which  optimal  solutions  must  be  found. 


'Itieor?m  6.  For  (P„)  a finite  set  of  solutions  can  be  constructed,  each 
member  of  which  is  optimed  over  some  6-range  [a,b] , where  0 ^ a < b ^ 1. 
The  union  of  these  ranges  is  [0,1).  (There  may  exist  solutions  which  are 
optimal  only  at  a single  value  of  6,  but  in  this  case  there  must  always 
be  an  alternative  optimum  which  remains  optimal  over  a nondegenerate 
interval  including  this  value.) 

Proof;  Follows  from  Theorem  5 and  from  the  fact  that  there  are  a finite 

number  of  break-points  for  v(P  ) V 0 e [0,1].  See  figure  below.  M 

0 

Note  that  in  the  fioure  each  straight  line  corresponds  to  a feasi- 
ble solution  for  (Pg) . The  heavy  line  denotes  v(Pg) . 
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The  next  lemma  states  a well-knovm  monotonicity  property  of  the  two 
portions  of  the  objective  function  of  (P0) , namely  cx  and  fx.  This 
property  will  enable  us  to  make  a statement  (Theorem  7)  concerning  the 
behavior  of  certain  varl2d3les  In  an  optimal  solution  of  (Pg)  as  6 is 
varied.  Let  x*(9)  he  an  optimal  solution  for  (P.)  . 

Lemma  1.  If  0 £ i.  ^2'  cx*(0j^)  £ cx*(62)  and  fx^O^^)  ^ fx^O^)  . 

Proof;  Without  loss  of  generality,  teUie  6^^  = 0 5md  • 1 since  c and  f 
are  arbitrary.  Clearly  cx*(0j^)  £ cx*(02)  euid  (c  + 02f)x*(02)  ^ 

(c  + 02f)x*(0^)  £ cx*(02)  + 02fx*(0j^).  Therefore  fx*(02)  <.fx*(0^).  || 

Our  next  result  utilizes  Theorem  5 and  Lenina  1 in  order  to  show 

that  it  is  possible  to  reduce  the  number  of  variables  in  (P  ) for  cer- 

u 

tain  values  of  0.  This  is  done  by  fixing  (pegging)  variables  to 
specific  values. 

Suppose  (P^)  and  (P^^)  have  been  solved  to  optimality,  and  a piece- 
wise  linear,  concave  v^per  bound  function  Ub(0)  has  been  found. 

Note  that  UB(0)  * v(Pq)  , UB(1)  = v(P^),  amd  that  UB(0)  will  have  at 
least  two  "pieces",  one  due  to  x*(0)  auid  othe  other  due  to  x*(l), 
fLSSuffling  cx*(0)  cx*(l).  There  may  be  more  tham  two  "pieces"  due  to 
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feasible  (but  not  optimal)  solutions  actually  found  In  the  process  of 


solving  (Pq)  and  (P^) . See  figure  below. 


(Dff)x*{0) 


vCP,) 


cx*(l) 


v(Pj^)-(c+f)x*(l) 


v{Pq)-cx*(0) 


^ feasible  but  not 
I optimal  solution 
I for  (P  ) 

•I  V 


Further,  suppose  that  x.  Is  a 0~1  Integer  varl2±>le  ^uld  let  a = 0 or  1. 


Theorem  7.  xf  xMO)  - a,  g Is  any  underestimate  of  v(P  |x.  ■ 1 - a) 

° ^o 

such  that  vvPq)  < g,  and  h is  any  underestimate  of  v(Pj^|x,  * 1 - a)  , 

\ hen  x^  .ray  be  pegged  to  the  value  a for  those  values  of  0 for  which 
,'o  . 

q + (h  - q)e  ^ UB(0)  . 


P:.q_f.  The  linear  function  g + (h  - g)0  is  a lower  bound  on 


v(Pg|Xj  ■ 1 - a)  by  concavity.  | 


The  figure  below  may  help  in  understanding  this  result.  In  this  case 
X.  may  be  pegged  to  the  value  a for  V 0 e [0,0^]  U We  note 

that  g and  h may  be  found  by  utilitzing  "penalties"  which  are  calcu- 
lated during  the  solution  process  for  (P^)  and  (P^^)  . 

. l'\  


v(Pq)-UB(0) 


v(Pj^)-UB(l) 


I"' 


g+(h-g)0 


Of  course  it  follonrs  that  if  an  underestimate  s of  v(P^|x^  - 1 - a)  for 

A « ^ « A 

some  e c (0,1)  is  known  which  is  greater  than  the  value  g -f  (h  - g)e, 
then  the  piecewise  linear,  convex  function  connecting  the  points  (g,0) , 
(s,e),  end  (h,l)  may  be  used  as  an  in^roved  underestimate  for 
v(P  |x.  1 - a)  with  attendant  improvements  in  pegging  x.  to  the  value 


a over  segments  of  [0,1] . 

The  next  result  gives  conditions  under  which  em  optimal  solution 

of  (P")  may  be  deduced  to  be  optimal  over  some  segment  of  [0,1] . This 
6 

result  also  enables  the  analyst  to  choose  judiciously  the  next  value 

A 

of  6 at  which  to  solve  (P*). 

0 

Let  UB(6)  be  a piecewise  linear,  concave  upper  bound  function  of 
v(P^)  where  UB(0)  ■ v(Pq)  amd  UB(1)  ■ v{Pj^).  Let  the  straight  lines 
AC  and  BC  make  up  the  function  UB(0)  (see  figure  below)  . 


Theorem  8.  a)  If  v(P  ) ■ v_, 

9c  9: 

v(F.)  V 0 s 10,11  • b)  It  v(P.  I 

9 6(. 

v(P9)  V 9 e [0,1] . 


then  the  lines  AC  and  BC  coincide  with 

* v^,  then  the  line  AB  coincides  with 
D 


Proof:  a)  The  lines  AC  and  BC  are  upper  bounds  for  v(P_).  Since 

Q 

UB(0)  * v(Pq)  , UB(1)  * v(P^),  and  UB(e^)  = v(P^  ),  and  since  v(Pg)  is 

piecewise  linear,  and  concave,  it  is  clear  that  AC  amd  BC  coincide 

with  v{Po)  V 0 e [0,1].  b)  Similarly,  since  UB(0)  = v(P_),  UB(1)  = v(P, ) 
y 0 1 

cUid  UB(0  ) = v(P  ),  line  AB  achieves  the  minimum  lor  a piecewise 
^ ®c 

linear,  and  concave  function,  and  hence  AB  coincides  with  v(p  ) , I I 

6 * 
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Basically,  the  theorem  states  that  if  v 
(Pq)  is  solved  for  V 0 e [0,1). 


■'Sc’ 


- or  v(Pq  ) » V^, 


then 


Remark;  a)  If  v(P^  ) = v (see  figure  below) , then  AC  coincides  with 

E 

the  function  v(p  ) v 6 e [0,0  J.  b)  If  ^ then  AB  coincides 

C °E  ^ 

with  v(P^)  V 0 e [0,1] . 


Of  course  an  analogous  result  holds  for  0 e (0  ,1). 

E C 

These  results  for  deducing  optimality  over  a range  of  0 are  very 

powerful,  and  may  enable  a substantial  reduction  to  be  made  in 

computation  time.  They  allow  the  cinalyst  to  solve  (P  ) at  selected 

0 

points  only,  emd  still  be  able  to  deduce  optimality  over  the  continuum 

[0,1].  It  is  clear  that  having  solved  (P^)  and  (P^)  , a likely  choice  of 

the  next  value  of  0 at  which  to  solve  (P  ) is  0_.  This  is  because  if 

6 C 

v(P  ) - V or  v(P  ) » V , the  entire  problem  for  V 0 £ [0,1]  is  solved 


»Mi^<»  *»■***»•*.?»» ' 


itaxt  we  consider  the  sensitivity  of  an  optimal  ILP  solution  to 
special  changes  in  the  cost  ccefficlents.  This  comes  within  the  realm 
of  PILP,  since  by  our  definition  a PILP  is  a collection  of  closely 
related  ILPs.  Consider  the  ILPs: 

min  cx  min  c'x 

(P)  Ax  ^ b (P')  Ax  > b 


x^  - 0,1  V j e J 
th 


x^  - 0,1  V j e J 


where  c'  ■ c except  in  the  k component.  Let  x be  an  optimal  solution 
to  (P)  . Piper  and  2Soltners  ( 1973a j state  a weaker  version  of  the 
following  result. 


iiff 


Thoorem  !?.  For  some  k e J,  suppose  Xj^  “ 1.  Then  x is  optimal  in  (P') 
if  and  only  if  Cj^  1 Cj^  + v(p|xj^  =*  0)  - v(P). 

A 

Proof;  Since  x is  feasible  in  (P'),  it  is  optimal  in  (P')  if  and  only 
if  c'x  £ v(P' ) . But  v(P' ) » min  {v(P'  |xj^  ■ 0)  , v(P'  |xj^  - 1)  } where 
v(P'|xj^  ■ 0)  - v(p|xj^  ■ 0)  auid  v(P'|xj^  » 1)  * c'x.  So  x is  o]>tliaal  in 
(P')  if  and  only  if  c'x  £ v(p|xj^  * 0)  where  c'x  = v(P)  ~ 1 | 

Corollary.  For  some  k e J suppose  Xj^  = 0.  Then  x is  optimal  in  (P') 
if  and  only  if  ^ " v(p|xj^  » 1)  + v(P). 

Note  that  in  an  application  one  may  not  know  the  value  for 
v(p|xj^  ■ 0)  in  Theorem  9,  but  through  the  use  of  "penalties"  one  may 
calculate  an  underestimate  of  this  value  which  can  be  used  in  the 


Theorem.  We  observe  that  the  remges  for  chemging  the  cost  coefficients 
are  valid  only  for  one-at-a-time  changes.  However,  by  restricting  this 
range,  simultaneous  chamges  can  be  made  in  cost  coefficients.  Let 
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(P')  - (P|Cj^  < Cj^  and  , (P")  - (P|cj^  “ and  _<  Cj^) , and 

(P"  ')  - (P|cj^  1 Cj^  and 

Theorem  10.  For  some  k,  £ e J suppose  = 1.  Then  x is  optimal 

in  (P''')  if  Cj^  Cj^  emd  ^ c^. 


Proof ; By  Theorem  9,  x remains  optimal  in  (P')  and  (P'').  We  will 
show  that  v(P'''|xj^  = ■ 1)  ^ min  {v(P' ' ' |xj^  * x^  - 0)  , v(P' ' ' |xj^  = 1, 

X ■ 0) , v(P'''|x  = 0,x  * 1)  } . First,  v(P'''|x  “ x * 1)  £ 

X lx  X )x  X 

v(P  |Xj^  = x^  ■ 1)  _<  v(P  |xj^  = x^  = 0)  = v{P'  ' ' |xj^  * x^  « 0)  . Second, 
v(P'''|x.  “ X = 1)  £v(P'|x  =x  ■ 1)  £v(P'|x^  = 1,  X = 0)  = 

lx  X lx  X K X 

v{P"'|x  = 1,  X = 0).  Third,  v(P"'|x  = x = 1)  £v(P"k  = x = 1) 

lx  X K X )x  X 

< v(P"  |xj^  = 0,  x^  - 1)  = v(P'"lxj^  = 0,  x^  = 1)  . II 


Defining  (Q'*')  = ^ c^)  we  have: 


Corollary.  For  some  k,  £ e J,  suppose  x,  = x„  = 0.  Then  x is  optimal 

IV  X 

in  (Q' ' ' ) if  c'  ^ c and  c'  ^ c . 

K lx  XX 

Note  the  difference  in  allowable  ranges  in  Theorems  9 and  10.  In 

Theorem  9,  the  cost  coefficient  of  a variable  may  be  increased  by  a 

certain  amount  or  decreased  by  an  arbitrary  amount . In  Theorem  10 , 

however,  the  cost  coefficients  may  only  be  decreased  arbitrarily.  This 

is  a direct  result  of  the  fact  that  v(p|xj^  - 0)  may  vary,  if  say,  c^^^ 

is  changed  as  is  done  in  Theorem  10.  Since  v(p|xj^  = 0)  no  longer 

remains  constant,  it  cannot  be  used  as  part  of  the  bound.  Finally,  we 

note  that  by  combining  Theorem  10  and  its  Corollary,  we  may  simultaneously 

decrease  cost  coefficients  c,  such  that  x,  =1,  emd  increase  cost 

k k 

coefficients  c^  such  that  x^  = 0. 
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This  completes  the  chapter  on  characteristics  and  properties  of 
particular  paraneterizations.  The  utilization  of  the  results  which 


have  been  given  depends  alanet  entirely  on  the  type  of  pareuneterizatlon 
in  the  PILP.  The  next  chapter  details  techniques  for  inproving 
algorithmic  efficiency  which  depend  on  the  specific  problem  class  (e.g./ 
capital  budgeting,  facility  location,  etc.)  being  solved. 
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III.  PROBLEM  DEPENDENT  TECHNIQUES  FOR  IMPROVING  ALGORITHMIC  EFFICIENCY 

Given  a PILP  made  up  of  ILPs  belonging  to  a special  problem  class, 
what  methods  are  available  which  would  improve  algorithmic  efficiency? 
Four  major  techniques  are  problem  reduction,  feasibility  recovery, 

. .ng  problem  reoptimization,  and  wide  range  bounding. 

Problem  reduction  refers  to  preliminary  finalysis  performed  on  a 
problem  which  may  result  in  ve..;iables  being  fixed  at  certain  values,  or 
additional  constraints  or  cuts  being  added  which  will  tighten  the 
initial  (and  succeeding)  relaxations.  Set  partitioning  problems 
(Marsten  [1971]  and  Garfinkel  and  Nemhauser  [1969])  are  prime  examples 
of  instances  where  logical  reduction  is  used  to  reduce  the  size  of  the 
problem.  Basically,  logical  tests  are  used  to  conclude  that  certain 
variables  must  take  on  specific  values  (pegging)  in  an  optimal  solution, 
and  that  certain  constraints  can  be  eliminated.  Heunmer  and  Nguyen 
[1972]  have  used  logical  tests  to  generate  precedence  relations  for 
general  0-1  Ilfs.  Examples  of  such  relations  are  x^  ^ or 
x^  + Xj^  £ 1.  However,  for  many  types  of  ILPs  such  analysis  is  not 
worth  the  effort  expended.  In  other  words,  the  ILP  can  be  solved 
faster  without  preliminary  analysis.  In  PILP,  on  the  other  hand,  if 
a single  prelimin^u^y  analysis  can  be  done  for  meuny  or  all  of  the 
individual  problems  in  the  PILP  with  little  or  no  modification,  then 
the  2uialysis  may  become  more  attractive  because  the  extra  work  cam  be 
amortized  over  the  whole  set  of  ILPs  in  the  PILP. 

Since  upper  bounds  on  the  optimal  solution  value  are  used  for 
fathoming,  generating  good  upper  bounds  is  of  primary  importance  in 
any  branch  and  bound  algorithm.  Feasibility  recovery  techniques  are 
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used  to  generate  these  upper  bounds.  The  technique  involves  teddng  em 


optimal  or  even  just  a feasible  solution  to  one  problem  and  modifying  It 


in  such  a way  that  it  becomes  feasible  in  euiother  problem  in  the  PILP. 


A simple  example  Is  the  mixed  Integer  linear  program  where  the  right 


hand  side  is  varied.  Given  the  optimal  solution  for  the  original 


problem,  fix  the  values  of  the  integer  variables,  and  then  reoptimize 


the  continuous  variadiles  using  the  new  right  hand  side.  If  the 


resulting  solution  is  feasible,  then  an  upper  bound  on  the  revised 


problem  has  been  found. 


Bounding  problem  reoptimization  is  another  promising  technique. 


Reoptimization  in  ILP  algorithms,  which  utilitze  LP  as  the  primary 


relaxation,  is  often  used  to  great  advantage.  Generally,  an  advanced 


basis  is  i:ised  from  the  preceding  candidate  problem  as  a starting  basis 


for  the  current  candidate  problem.  Reoptimization  then  proceeds  using 


the  dual  sinqplex  method.  In  PILP  this  approach  would  also  be  used, 


but  there  is  yet  another  application.  By  referring  to  the  rudimentary 


branch  emd  bound  algorithm  in  chapter  I,  we  see  that  it  is  possible 


to  choose  a subset  S of  candidate  problems  from  the  candidate  list. 


If  these  candidate  problems  are  closely  related,  then  a reoptimization 


technique  would  probably  be  cin  efficient  method  for  generating  an 


optimal  solution  to  the  relaxation  for  each  member  of  the  set  S.  Such 


a procedure  could  result  in  smaller  storage  requirements  as  well  as 


reduced  computation  time. 


A fourth  technique  we  dvib  wide  reinge  bounding.  Generally  this 


technique  is  beised  on  the  formal  Lagrangean  dual,  emd  depends  on  find- 


ing feasible  dual  solutions  which  serve  as  valid  bounds  on  the  optimal 


values  of  the  primal  problems  in  the  PILP.  Oftentimes,  dual  feasible 


solutions  are  inexpensive  to  calculate,  emd  at  the  S2une  time  may  be 
surprisingly  good  approximations  to  the  optimal  value  of  the  primal 
releucatlon.  Thus,  these  methods  may  be  used  in  place  of  (or  in  con- 
junction with)  the  reoptimization  techniques  in  the  previous  paragraph. 
The  tradeoff  involved  is  that  confutation  time  is  reduced  at  a cost  of 
producing  a weaker  (dual)  bound.  Examples  of  wide  range  bounding 
applied  to  the  continuous  objective  function  and  the  continuous  right 
hcuid  side  parameter! zaticns  are  given  below. 

Consider  the  problem: 

For  V 0 e [0,1]  solve: 

min  (c  + 0f)x 
xeX 

(P„)  Ax  > b 

Xj  integer,  j e j 
where  X is  a compact  poly  tope. 

Suppose  that  a set  of  dual  multipliers  X ^ 0 for  the  Ax  ^ b 

A 

constraints  have  been  generated  for  some  0 e [0,1].  We  know  from 

duality  theory  that:  v(P")  ^ + X (b  - Ax)] 

_ ^ ” X^  0 xeX 

^ inf  (c  + 0f)x  + X(b  - Ax).  Also  it  follows  for  any  ocher  set  of 
xeX  - ^ 

dual  multipliers  X > 0 that:  v(P  ) > v(W  ) = meuc  {inf  (c  +0f)x  + 

" - A 

X(b  - Ax)  ; inf  (c  +0f)x  + X (b  - Ax)}  . Now  since  v(0;X)  = 

xeX 

inf  (c  + 0f)x  + X(b  - Ax)  is  a piecewise  linear,  concave  function  of 
xeX 

9 (for  fixed  X),  and  since  v(D  ) is  also  a piecewise  linear,  concave 

6 

function  of  0,  we  have  the  situation  shown  in  the  figure  below. 
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Since  v(P.)  > v(D.)  > v(W.)  and  since  v(D-)  is  piecewise  linear  and 
6 — o — 0 0 

concave,  we  may  improve  v(H  ) by  filling  in  the  non-concave  portions 

6 

of  v(W  ) as  shown  by  the  dotted  lines  in  the  figure.  Of  course  this 
0 

analysis  holds  for  euiy  number  of  choices  of  X ^ 0 for  use  in  the 
calcvilation  of  v(W  ).  In  essence  we  are  only  applying  the  fact  that 

O 

v(Dg)  must  be  concave. 

Next  we  consider  the  problem: 

For  V 0 € [0,1]  solve: 

min  cx 
xeX 


'“e> 


Ax  > b + 0r 


Xj  integer,  j e J 
where  X is  a conpact  polytope. 

Suppose  that  we  generate  two  sets  of  dual  multipliers  X ^ 0 and 


X ^ 0 for  (Hg)  • Then  v(H^)  ^ v(G^)  = aax  {X(b  + 0r)  + inf  (c  - XA)x 


0 


'0 


xcX 


X (b  + 0r)  + inf  (c  - XA)x}  . Note  the  interesting  property  that  the 


xeX 

"inf"  problems  do  not  depend  on  9.  This  suggests  that  the  conputa- 

tion2d  burden  of  finding  a dual  bound  for  (H  ) V 6 c [0,1]  would  be 

0 

very  cheap.  Still  another  dual  bound  may  be  obtained  from  the  LP 

tableau  of  (H^)  (if  LP  is  used  as  the  primary  releucation) . Suppose 

that  we  have  an  optimal  tableau  for  (H") , The  primal  solution  values 

0 
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of  the  basic  variables  are  represented  in  the  teibleau  by  B (b  + Or)  . 
Now  for  some  other  value  of  6»  this  basis  may  be  infeasible.  But  if 
the  dual  simplex  method  is  used  to  regain  primal  feasibility,  we  may 
generate  a dual  bound  for  all  6 at  each  dual  sinq?lex  iteration,  since 
dual  feasibility  is  retained  in  the  dual  simplex  algorithm. 
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IV.  SCHEDULING  SOLUTION  PRIORITIES  FOR  PILPS 

In  solving  the  PILP  important  decision  which  must  be  made  is 
the  establishment  of  solution  priorities.  Specifically,  should  equal 
effort  be  given  to  solving  all  of  the  problems  in  tne  PILP  at  all  times, 
or  should  some  priority  scheme  be  initiated  whereby  one  problem  or 
some  subset  of  problems  is  solved  to  optimality,  euid  then  cUiother 
subset  is  solved?  The  priority  scheme  to  be  devised  should  take  into 
account  the  type  of  parameterization  and  its  attendant  characteristics 
and  properties  (chapter  II)  , problem  class  dependent  techniques  (chapter 
III)  , as  well  as  aspects  identified  in  the  first  part  of  this  chapter. 

An  import2mt  factor  vrtiich  plays  cui  intimate  role  in  the  formulation 
of  PILP  branch  euid  bound  algorithms  is  whether  the  solution  of  one  prob- 
lem is  likely  to  furnish  information  useful  for  solving  other  problems 
in  the  PILP.  Three  aspects  of  this  factor  will  be  outlined  in  this 
chapter.  The  first  aspect  is  the  tightness  of  the  primary  relaxation  as 
a function  of  the  problem  set  index.  The  second  is  the  behavior  of  in- 
dividual integer  variables  in  an  optimal  solution  as  the  problem  set 
index  varies.  The  third  is  the  question  of  whether  a branch  and  bound 
tree  for  one  problem  in  the  PILP  is  a "good"  bremch  and  bound  tree  for 
another  problem  in  the  PILP. 

The  gap  between  the  optimal  integer  completion  value  euid  the  opti- 
mal relaxation  value  at  a given  node  in  a branch  cuid  bound  tree  is  a 
measure  of  the  tightness  of  a releixation.  This  gap,  of  course,  is  de- 
pendent on  the  problem  set  index.  The  behavior  of  the  gap  function  is 
an  important  factor  in  deciding  on  the  priority  for  solution  of  the  ILPs 
making  the  PII-^,  since  it  would  seem  likely  that  problems  with  smaller 


35 


1 


] 


I 


f 


gaps  are  euier  to  solve  than  those  with  large  gaps.  This  will  become 
clearer  later  in  the  chapter  when  various  solution  priorities  are  out- 
lined. In  addition  it  may  be  the  case  that  solving  a "small  gap'  prob- 
lem first  may  enable  good  feasible  solutions  for  closely  related  prob- 
lems to  be  generated  by  feasibility  recovery  techniques. 

Behavior  of  individual  integer  variables  in  an  optimal  solution  as 
the  problem  set  index  varies  is  also  an  inportant  consideration. 
Intuitively  we  ask  the  following  questions:  a)  do  the  optimal  solutions 
remain  relatively  stable  as  the  problem  set  index  varies?  b)  do 
"importeuit"  variables  tend  to  remain  "important"  as  the  problem  set 
index  varies?  Both  questions  c^ul  be  clarified  by  appealing  to  the 
notion  of  "integer  A's."  For  a 0-1  integer  variable,  x^ , define 
A(j)  ■ v(p|xj  ■ 1)  - v(p|xj  » 0).  Intuitively  A(j)  may  be  thought  of 
as  an  indicator  of  the  "importance"  of  x^  in  an  optimal  solution  of  (P)  . 
If  |A(j)  I is  small,  then  the  value  of  x^  does  not  have  much  effect  on 
the  solution  value.  It  follows  that  in  a branch  and  bound  process, 
important  variables  should  be  the  varied^les  on  which  bremching  is  done 
initially.  Clearly,  then  question  b)  would  seem  to  be  vital,  for  it  is 
directly  related  to  the  third  factor  which  we  shall  now  examine. 

The  question  of  "good"  branch  cind  bound  trees  for  problems  in  a 

PILP  can  best  be  examined  by  considerinq  the  notion  of  "scratch  tree" 

dynamics.  Given  a PILP  indexed  by  k,  and  given  a traditional  ILP 

algorithm,  a scratch  tree  is  defined  to  be  the  branch  and  bound  tree 

th 

resulting  from  applying  the  ILP  algorithm  to,  say,  the  k problem  in 
the  PILP  from  scratch  without  the  benefit  of  any  prior  information. 
Scratch  tree  dynamics  is  the  study  of  how  the  scratch  trees  change  as 
the  problem  set  index,  k,  varies.  If  the  scratch  trees  remain 
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reasonably  stable  as  a function  of  the  problem  set  index,  then  it  is 
likely  that  the  scratch  tree  for  the  problem  will  bo  a "good"  ini- 

tial •roazation  for  the  other  problems.  We  observe  that  a scratch  trt 
consists  of  two  types  of  nodes  — fathomed  nodes  2md  unfathomed  nodes. 

If  a node  is  unfathomed  for  one  problem,  it  is  reasonable  to  presume 
that  the  corresponding  node  will  be  unfathomed  for  a closely  related 
problem  (assuming  that  the  same  type  of  bounding  releucation  is  used) . 
While  this  may  not  always  be  so,  it  does  afford  a rationale  for  inspect- 
ing only  the  fathomed  nodes  of  the  original  problem.  Furthermore,  since 
the  fathomed  nodes  form  a partition  of  the  feasible  solutions  of  the 
problem,  no  optimal  solutions  ccm  be  missed  by  using  this  set  of  nodes 
as  an  initial  candidate  list  (initial  separation)  for  cmother  problem  in 
the  PILP.  Thus  we  may  choose  to  use  the  set  of  fathomed  nodes  as  an 
initial  separation  for  another  problem  in  the  PILP.  This  is  the  tack 
used  by  Roodm^m  [1972,1973]  in  his  study  on  ILP  sensitivity. 

Armed  with  a better  understanding  of  the  factors  which  are  of 
major  consequence  in  the  formulation  of  PILP  branch  and  bound  algorithms 
we  now  consider  the  scheduling  of  solution  priorities  for  individual 
problems  in  a PILP.  There  are  at  least  three  solution  priorities  for  a 
PILP  bremch  and  bound  algorithm. 

The  first  approach  is  purely  serial.  One  problem  in  the  PILP  is 
solved  to  optimality,  and  then  using  the  information  gleaned  from  this 
problem  the  next  problem  is  solved  to  optimality.  This  procedure 
continues  until  all  problems  have  been  solved.  Information  which  might 
be  of  use  for  future  problems  includes:  choice  of  an  initial  separation 
choice  of  branching  rules  and  their  operating  parameters,  knowledge  of 
a good  upper  bound,  relative  emphasis  placed  on  fathoming  and  pegging 
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machinery,  choice  of  quitting  threshold,  and  avoidance  of  nodes  which 
are  likely  to  be  unfathomable. 

A second  approach  Is  lexicographically  serial.  Let  the  problem 

set  be  Indexed  by  k.  The  procedure  begins  as  though  (P^)  Is  the 

only  problem  to  be  solved.  Branching,  pegging,  and  fathoming  machinery 

axe  devoted  wholly  to  (P  ) until  at  some  node  (CP,  ) Is  fathomed. 

1 

Then  at  this  node  the  relaxation  for  (CP_  ) Is  solved  (hopefully 

2,R, 

by  reoptimizing  the  (CP  ) relaxation  at  the  node)  . If  (CP,  ) Is 

fathomed,  the  (CP  ) relaxation  is  solved  to  optimality,  etc.  If 
3,R. 

(CP  ) is  not  fathomed,  then  branching  continues  from  that  node  with 

2 i 

the  breuxchlng,  pegging,  and  fathoming  machinery  devoted  wholly  to  (P^)  . 
When  a (CP  ) is  finally  fathomed  at  a node,  the  (CP  ) relcixatlon 


is  solved  to  optimality  at  that  node.  The  process  continues  in  this 
m^mner  and  backtracking  In  the  branch  emd  bound  tree  occurs  naturally 
with  each  unfathomed  node  being  tagged  with  the  Index  of  the  problem 
to  which  the  branching,  pegging,  and  fathoming  machinery  will  be 
initially  devoted. 

A purely  parallel  approach  is  another  possibility.  At  each  node 
the  relaxations  for  (CP  ) , (CP  ),...,  (CP  ) are  solved.  If 

.L  / R^  2 f lx  f 

some  problems  are  fathomed,  they  are  dropped  from  further  consideration 
at  ^uly  descendant  of  the  node.  When  all  problems  which  remain  under 
consideration  at  a node  are  fathomed,  backtracking  from  that  node 
occurs . 

The  parallel  approach,  then,  relies  on  the  assumption  that  solving 
a series  of  closely  related  problems  at  a given  node  can  be  accomplished 
relatively  efficiently.  The  purely  serial  approach  on  the  other  hand 
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relies  on  the  assumption  that  information  gedned  from  solving  one 
member  of  the  PILP  will  be  helpful  in  jolving  another  member  of  the 
PILP.  The  lexicographically  serial  method  is  one  possible  conpromise 
between  the  two  approaches. 

At  this  point  we  present  an  analysis  which  under  certain  assump- 
tions establishes  a bound  on  the  savings  in  computation  time  which 
can  be  achieved  by  the  serial  and  lexicographic  serial  methods,  over, 
say,  the  traditional  approach  where  each  problem  in  the  PILP  is  solved 
from  scratch.  We  assume  that  LP  optimizations  (or  indeed  any  other 
optimizations)  require  the  same  amount  of  computation  time  at  all  nodes 
in  the  branch  and  bound  tree.  While  this  is  not  generally  the  case,  it 
does  allow  for  a simpler  amalysis.  The  assumption  may  be  dropped  at 
the  cost  of  conplicating  the  conclusions  somewhat. 

Consider  an  arbitrary  branch  and  bound  tree  with  the  set  of 
fathomed  nodes  denoted  by  N. 

Remark.  If  a branch  eind  bound  tree  has  |n|  fathomed  nodes,  then  there 
are  |n|-1  unfathomed  nodes  in  the  tree. 

Proof;  By  construction  using  the  fact  that  2^+2^+.  . .+2  ^ ^ = 2^^^-l.  | 

Thus  we  see  that  the  number  of  fathomed  nodes  is  approximately  50%  of 
the  total  number  of  nodes  investigated  in  a branch  and  bound  procedure. 
If  the  serial  method  is  used  for  a PILP  which  utilizes  the  set  of 
fathomed  nodes  as  an  initial  separation,  then  the  maximum  savings  in 
the  number  of  nodes  investigated  is  50%  over  an  approach  where  each 
problem  is  solved  from  scratch.  This  holds  for  the  lexicographically 
serial  method  as  well.  Thus  there  is  an  upper  bound  on  the  savings 


which  can  b«  r««li*ed  using  the  aerial  or  lexicographic  serial 


approaches  instead  of  the  traditional  approach  • 


In  this  chapter  we  consider  the  parametric  0-1  knapsack  problem. 
Three  specific  parameterizations  will  be  examined: 

1)  For  k ■ 1,...,K  solve: 


max  cx 

(P^)  x-0,1 

wx  < B - t, 
— k 

2)  For  k = 1,...,K  solve: 

max  (c  + f,  )x 
x.0,1 

WX  < B 


3)  For  V 0 e [0,1]  solve; 


%> 


mcix  (c  + 0f)x 
x=0,l 

wx  < B 


where  c,  f,  f^,  w are  conformable  n-vectors  and  B,  tj^  are  scalars. 
Without  loss  of  generality  we  assume  throughout  this  chapter  that 
c,  w > 0,  B > 0,  and  0 = t^^  < < ...  < tj^  < B. 

The  0-1  knapsack  is  a very  simple  model.  One  important  applica- 
tion is  the  capital  budgeting  problem  with  one  budget  constraint. 

Problem  formulations  1)  , 2)  , eind  3)  allow  for  flexibility  in  the  budget, 
the  cost  coefficients,  and  in  the  maximizing  criteria  respectively.  Per- 
haps a more  important  use  of  the  0-1  knapsack  problem  is  as  a subprob- 
lem f(. r a larger  model.  One  simple  example  is  a general  capital  budget- 
ing problem  (with  m budget  constraints).  By  Lagrangeanizing  all  the 
budget  constraints  but  one  into  the  objective  function,  a 0-1  knap- 
sack problem  results.  Under  certain  conditions  this  relaxation  of  the 
original  problem  cam  be  shown  to  be  at  least  as  strong  a relaxation  as 


the  traditional  LP  relaxation. 


The  outline  for  this  chapter  is  as  follows.  First,  an  efficient 


algorithm  for  the  0-1  knapsack  problem  will  be  stated.  Then  algorithms 
for  each  type  of  parameterization  will  be  outlined,  computational  re- 
sults will  be  cited,  and  conclusions  will  be  drawn  concerning  the  most 
effective  methods  for  solving  each  parametric  0-1  knapsack. 


A.  An  Algorithm  for  the  0-1  Knapsack  Problem 


Consider  the  problem: 


max  cx 


x”0,l 


wx  < B 


By  capitalizing  on  the  simplicity  of  this  problem,  it  is  possible  to 

achieve  substantial  savings  in  confutation  time  over,  say,  a general 

0-1  ILP  code.  There  are  two  properties  of  (P)  which  may  be  exploited 

successfully.  First  we  assume  that  the  variad^les  have  been  ordered  by 

®1 

decreasing  "bang-for-buck”  ratios  so  that  — > — > ...  > — . With 

Wi  - w^ 

this  ordering  the  solution  to  the  linear  program  (F)  (replacing  x >=  0,1 
by  0 j<  X £ 1)  becomes  analytic.  That  is,  variables  with  the  largest 
bemg-for-buck  are  placed  in  the  knapsack  at  their  upper  bounds  of  1 
until  no  more  room  remains  in  the  knapsack.  At  this  point  the  variable 
which  could  not  fit  is  placed  in  the  knapsack  at  a fractional  level 
such  that  the  knapsack  is  filled.  It  is  clear  that  all  variables,  with 
the  possible  exception  of  one,  have  value  0 or  1 in  an  optimal  solution 
to  (P) . It  follows  that  by  setting  the  fractional  variable  to  0,  feas- 
ibility in  (P)  is  achieved,  so  that  a lower  bound  on  v(P)  is  readily 
avcdlable.  It  is  these  two  properties  (an  analytic  solution  to  (P)  and 
r.  sinfle  feasible  solution  generator)  which  are  exploited  in  the  algo- 
rithm below. 
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Korsh  and  Ingaragiola  (KI)  [1973]  have  developed  an  algorithm  for 
0-1  knapsacks  which  has  proved  to  be  very  effective  In  reducing  compu- 
tation times.  Basically  they  employ  an  Inexpensive  LP  test  which,  if 
passed,  allows  a variable  to  be  pegged  to  0 or  1 at  the  root  (initial) 
node  of  a breuich  eind  bound  tree.  Computational  results  show  that  up- 
wards of  80%  of  the  variables  may  be  pegged  to  0 or  1.  The  reason  for 
such  powerful  pegging  Is  that  the  gap  between  v(P)  and  the  lower  bound 
found  by  the  feasible  solution  generator  Is  generally  small.  Once  the 
pegging  tests  are  completed,  the  "reduced"  knapsack  problem  consisting 
of  the  unpegged  variables  Is  solved  by  aiiy  available  knapsack  algorithm. 
Since  computation  time  for  the  pegging  test  is  linearly  proportional  to 
the  number  of  variables,  and  a branch  and  bound  approach  is  generally 
exponentially  proportional,  such  a de/ice  would  appear  to  be  quite  at- 
tractive. This  is  indeed  true,  since  the  KI  approach  reduced  computa- 
tion times  by  a factor  of  5 for  50  variable  problems  and  Ly  over  a fac- 
tor of  30  for  1000  variable  problems. 

Dembo  [1974]  has  noted  that  the  concept  of  Lagrangean  relaxation 
may  be  used  in  carrying  out  the  KI  pegging  tests.  While  his  test  is 
slightly  weaker  than  the  KI  test,  the  con?3utation  time  required  for  the 
pegging  phase  only  is  about  ?/3  less  than  for  the  KI  method. 

The  branch  and  bound  algorithm  used  by  KI  was  the  Greenberg  and 
Hegerich  (GH)  [1970]  algorithm  which  until  recently  was  the  most  effi- 
cient knapsack  algorithm  However,  Horowitz  and  Sahni  (HS)  [1974]  have 
developed  a bremch  and  bound  algorithm  which  dominates  the  GH  algorithm. 
We  present  a variant  of  the  HS  algorithm  which  has  decreased  computa- 
tion times  (in  the  branch  and  bound  phase)  by  approximately  1/3  over 
the  original  HS  algorithm. 
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In  order  to  nudce  the  presentation  of  the  algorithm  clear,  we  shall 
appeal  to  the  general  branch  and  bound  freunework  given  in  Geoff rion  and 
Marsten  [1972].  An  explzmation  of  the  finer  points  of  the  algorithm 
will  be  deferred  until  later. 

Algorithm  A; 

c c 
1 2 

1.  Order  the  variables  by  decreasing  bang-for-buck  so  that  — ^ ^ 

c ”1  '^2  , 

...  > — . Set  I » - in. 

— w 10^ 

II  _ 

2.  Solve  (P)  getting  w optimal  solution  x and  cui  optimal  dual  multi- 
plier X associated  with  the  budget  constraint.  If  x is  feasible 
in  (P) , stop:  the  solution  is  optimal.  Otherwise  denote  the 
index  of  the  fractional  variedile  by  r. 

3.  Find  a lower  bound  z*  for  v(P)  by  setting  x^  * 0 in  the  solution 
to  (P) . Let  X*  = X. 

4.  Try  to  in^irove  z*  by  certain  heuristics. 

5.  For  y i * l,...,r-l,  if  v(P)  - c.  + Xw.  £ z*,  set  I = I U {i} 

(x^  is  pegged  to  1) . 

6.  For  V i - r+l,...,n,  if  v(P)  + - Xw^  £ set  I^^  = 1^  U {i} 

(x^  is  pegged  to  0) . 

7.  Solve  the  remaining  knapsack  problem: 

(R)  Max  E c.  + E c.x. 

ielj  ^ i/JliUIo 

E w.x.  < B - E w. 

. _ 1 1 — . _ 1 

iZ-IltHo 

by  using  the  branch  and  bound  procedure  in  steps  8-18. 

8.  Initialize  the  cemdidate  list  to  consist  of  (R)  and  let  the  incum- 
bent value  be  z*. 

9.  If  the  candidate  list  is  enpty,  stop:  x*  is  an  optimal  solution 

44 


a. 


. . ...  •»^*;.'t1i?''«j"r'WW'‘''"'’"' 


*« 


uo  (P)  and  z*  Is  the  optimal  value. 

10.  Select  a candidate  problem  (CP)  from  the  cwdldate  list  by  a LIFO 
rule. 

11.  Solve  (CP)  getting  an  optimal  solution  x. 

12.  If  (CP)  is  infeasible,  go  to  9. 

13.  If  v(CP)  £ z* , go  to  9. 

14.  If  an  optimal  solution  of  (CP)  is  feasible  in  (CP),  go  to  18. 

15.  Choose  that  which  is  the  free  variable  with  the  largest  bang- 
for-buck. 

16.  If  w,  < B - Z w^  , then  add  only  (CP|x,  = 0)  to  the  candi- 

^ ~ i:x^  set  to  1 ^ 

date  list,  add  the  restriction  x^  = 1 to  (CP),  and  go  to  15. 


Otherwise  go  to  17. 

17.  If  w.  > B - E Wj^ 

^ i:Xj^  set  to  1 


, add  the  restriction  x^  * 0 to  (CP)  , 


choose  that  x^  which  is  the  free  variable  with  the  largest  bang- 
for-budc,  and  return  to  the  beginning  of  this  step.  Otherwise  go 
to  11. 

18.  A feasible  solution  to  (P)  has  been  found.  Set  z*  » v(CP),  x*  = x, 
and  go  to  9. 

In  step  2 cin  optimal  dual  muJtiplier  1 for  (P)  can  be  shown  to  be 
c 

equcil  to  — . In  step  4 two  heuristics  are  used  in  an  attenpt  to  im- 
r _ 

prove  the  value  of  z*.  First,  set  x = x and  x^  = 0.  The  solution  x 

then  has  a sladc  in  the  constraint  with  value  s = x "W  . Now,  for 

r r 

i = r+l,...,n  the  following  is  done:  if  w^  ^ s,  set  x^  = 1 and  s - 
s - w^.  If  s > 0,  repeat  this  step  for  i=i+l.  Ifcx>z*,  set 
z*  = cx  and  x*  = x.  Basically,  this  heuristic  puts  extra  variables  in 
the  )cnapsac)(  until  no  more  variables  fit.  The  second  heuristic  begins 
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by  setting  x ■ x and  x^  ■ 1.  This  overfills  the  knapbcoi^  by  s ■ 

(1-x^) ‘w^.  Then  for  i ■ r-l,r-2,. . . ,1  the  following  is  dor.e:  set 
- 0,  s ■ s - w^,  and  if  s > 0 repeat  this  step  for  i ■ i - 1.  When 
s £ 0,  set  s " -s  2Uid  return  to  the  test  loop  in  the  first  heuristic. 
Thus  this  heuristic  begins  by  overfilling  the  knapsack,  and  then  vari- 


ables are  withdrawn  until  feasibility  is  obtained.  At  this  point  the 
teat  loop  in  the  first  heuristic  is  employed.  The  pegging  tests  in 
steps  5 and  6 utilize  the  notion  of  Lagrangean  relaxation  (LGR) . Con- 
sider the  relaucation: 


max  cx  + A{B  - wx) 
X"0,1 


It  is  easily  seen  (Geoffrion  11973])  that  v(LGRj^  “ v(P)  where  X 1*1  an 
optimal  dual  multiplier  for  (P) , and  that  the  solution  to  (LGR—)  is 
analytic.  That  is , 

-1  if  c,  - Xw.  > 0 

/ i 1 

*i  - { 

*■0  if  c.  - Xw.  <0 

1 1 — 

Thus  we  have  v(LGR— lx.  = 1)  ■ v(P)  + c.  - Xw.  if  x.  = 0,  and 

AX  XXX 

v(LGRHx.  ■ 0)  * v(P)  - c.  + Xw.  if  X.  = 1.  Since  v(LGR, ) < v{P)  v 
X ^ 0,  it  follows  that  the  pegging  tests  are  valid.  Steps  5 amd  6 may 
be  enhamced  by  adding  the  following  tests  if  the  LGR  test  fails: 

5b.  If  v(p|x^  = 0)  £ z*,  then  set  {i}. 

6b.  If  v(p|x^  » 1)  £ z*,  then  set  U {i}. 

The  branch  auid  bound  algorithm  of  steps  8-18  is  straightforward, 
but  a few  comments  may  madce  it  cleaurer.  In  step  10  a LIFO  selection 
rule  is  used,  thus  guaranteeing  lineau:  storage  and  minimal  setup  costs 
in  a computer  implementation.  Step  14  is  an  addition  to  the  HS  imple- 


mentation which  recognizes  that  if  a relaixation  has  an  optimal  integer 
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feasible  solution,  then  the  current  candidate  problem  may  be  fathomed. 
The  branching  strategy  In  steps  15-17  Is  done  as  follows.  The  most 
attractive  free  variable  (in  terms  of  largest  b^ulg-for-buck)  Is  chosen 
as  the  branch  variable.  However,  since  this  varl^d>le  has  value  1 In 
(CP),  we  have  v(Cp|xj  ■ 1)  » v(CP).  Thus,  no  reoptimization  is  re- 
quired, and  the  next  breuich  variable  may  be  chosen.  This  continues 
until  the  next  variable  chosen,  x^  , cannot  fit  In  the  )cnapsack  at  a 
level  of  1.  But  this  implies  that  x^  may  be  pegged  to  0 due  to  feasi- 
bility considerations.  Pegging  variables  to  0 continues  until  no 
longer  possible.  At  this  point  control  is  returned  to  step  11,  emd  the 
releucation  of  the  current  candidate  problem  is  solved.  In  actuality,  a 
group  of  variables  (contiguous  by  index)  are  committed  to  1 until  this 
is  no  longer  possible,  and  then  a group  of  variables  (contiguous  by 
index)  2u:e  pegged  to  0 until  this  is  no  longer  possible . This  allows 
the  LP  in  step  11  to  be  bypassed  after  most  branc)iing  operations,  which 
in  turn  reduces  computation  time  measurably.  This  is  seen  in  Table  A 
where  the  HS  algorithm  (as  coded  by  HS)  is  compared  to  steps  8-18  of 
Algorithm  A.  Note  that  steps  1-7  were  omitted  in  these  runs.  Both 
algorithms  were  coded  in  EXDRTRAN  H and  run  on  an  IBM  360/91.  Reuidom  c^ 

and  w.  were  generated  from  a uniform  distribution,  U [10,100]  , and  B was 
n 

set  to  .5'(  L w.).  Results  show  that  steps  8-18  of  Algorithm  A ro- 
i-=l  ^ 

duced  computation  time  by  33%  when  compared  with  tlie  HS  algorithm. 

Results  for  all  of  Algorithm  A (steps  1-10)  are  given  in  Table  B. 
These  results  clearly  dominate  KI’s  results,  even  when  machine  differ- 
ences eure  taken  into  account.  Table  C shows  this  dominance.  The  trend, 

as  the  number  of  variables  increases,  definitely  is  in  favor  of  Algo- 
ritiim  A. 
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Quadrupling  the  number  of  variables  Increases  computation  time  by 
a factor  of  1.7>  while  for  KZ  this  factor  Is  4.2.  Finally,  we  mention 
that  Inclusion  of  steps  5b  and  6b  In  Algorithm  A vias  Ineffective,  and 
In  fact  Increased  computation  times  slightly. 


I B.  The  0-1  Knapsack  Problem  with  a Finite  Nximber  of  Right  Hamd  aides 

l 

I 

f In  this  section  we  consider  problem  1) . it  Is  well  known  that 

I 

I optimal  solutions  for  all  right  hand  sides  from  1,2,...,B  are  available 

I as  a by-product  If  (P)  Is  solved  via  dyneunlc  programming  (DP)  . However, 

with  the  rocr.nt  developments  In  knapsack  branch  and  bound  technology  as 

I expounded  upon  In  section  A,  we  shall  see  that  for  problems  with  a rea- 

! 

I sonable  number  of  right  hand  sides,  the  branch  and  bound  approach  Is 

f 

i 

■ more  efficient  both  In  computation  time  and  In  storage  requirements. 

: From  a practical  point  of  view  we  note  that  If  the  various  right 

; hand  sides  to  be  considered  In  1)  cover  a large  range,  then  within  that 

t 

range  It  Is  possible  to  find  optlm2d.  Integer  solutions  for  certain 
budgets  by  singly  filling  the  knapsack  using  the  bang-for-buck  ordering. 
These  budgets  correspond  precisely  to  tho^e  right  hand  sides  within  the 
remge  which  have  a naturally  integer  solution,  so  that  v(P)  = v(P). 
Occaslonedly  this  might  be  all  that  Is  needed,  and  of  course  such  ^ul 
analysis  may  be  done  by  hand  calculation. 

As  an  initial  step  in  developing  an  algorithm  for  1)  , we  investi- 
gate the  problem  dependent  techniques  of  chapter  III.  Then  factors 
affecting  the  scheduling  of  solution  priorities  of  chapter  IV  will  be 
considered,  three  algorithms  will  be  given,  and  conclusions  will  be 
drawn  concerning  the  most  efficient  algorithm. 

Reduction  techniques  can  be  an  effective  means  for  reducing 


48 


WTjUf  ■. 


I 


computation  time.  The  KI  reduction  used  In  Algorithm  A is  a cleisslc 
example.  VThlle  this  test  applies  only  for  a given  right  hand  side,  the 
number  of  computations  required  is  minimal  — 1 multiplication,  1 addi- 
tion, 1 subtraction,  and  1 ccmparison  p®r  variable.  Hence,  even  when 
repeated  for  a number  of  right  hand  sides,  the  computational  effort  is 
snudl.  Another  reduction  techniqum  (which  is  independent  of  the  right 
hand  side)  is  based  on  the  following  elementary  result: 


Theorem  11.  If  c.  > c.  and  w.  < w.  then  the  constraint  x.  > x.  may  be 
1 - j i - 3 i - D ' 

added  to  1)  without  affecting  the  optimal  solution  values  for  (P  ) v 

Iv 

Ic  * 

Proof:  Assine  x*  ■ 1 and  x*  - 0 in  an  optimal  solution  for  (P^^)  . Then 

let  X « X*  except  x,  - 0 and  x.  ■ 1.  Since  w.  < w.,  this  revised  solu- 

:i  1 i ~ 3 

tion  remains  feasible,  and  since  c^  — *^j'  ^ objective  value  at 

least  as  great  as  v{Pj^).  Since  this  is  valid  for  each  (P^^)  individual- 
ly, it  must  hold  for  (Pj^)  v k » 1,...,K.  || 

This  means  that  if  is  pegged  or  set  to  0,  then  may  be  pegged 
to  0 also.  Similarly  if  x^  is  pegged  or  set  to  1,  then  x^  may  be 
pegged  to  1. 

Feasibility  recovery  techniques  allow  one  to  recover  a feasible 


sc'ution  for  (P^)  , say,  given  an  optimal  (or  even  just  feasible)  solu- 
tion for  (Pj ) . Suppose  that  a feasible  solution  x has  been  found  for 

(P^)  where  B-t^^^wx^B-t^-  One  approach  is  to  find  {j|x.  = 1 

c c.  « ^ 

arid  — ^ = min  — }.  Then  set  x,  = 0.  Ifwx<B-t„,xisa  feasible 
w.  . - w,  T — 2 

j i;xi-l  i ■’ 

solution  for  (P^) . If  not,  repeat  the  process.  This  approach  simply 
removes  the  veri^d}le  which  has  the  worst  bang-for-buck  from  the  knap- 
sack. Of  course,  a multitude  of  other  feasibility  recovery  techniques 


i 


j 

i 

) 

; 

f, 
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can  ba  derived  tie  well. 

Next  we  examine  bounding  problem  reoptimization  techniques.  Due 
to  the  analytic  nature  of  the  LP  solution  for  (?y) , it  Is  cleu  that 
reoptimization  may  be  handled  very  easily.  All  that  Is  required  Is  to 
keep  track  of  the  level  of  the  fractional  variable,  and  then  to  reduce 
Its  value  until  It  reaches  a level  of  0,  or  until  the  budget  constraint 
Is  satisfied,  whichever  comes  first.  If  the  budget  constraint  is  not 
satisfied,  the  next  (contiguous  by  Index)  variable  equal  to  1 In  the 
original  LP  is  reduced  In  the  same  manner. 

Finally,  wide  rwge  bounding  methods  may  be  employed.  However, 
due  to  the  efficient  if  reoptimization  available,  such  bounding  tech- 
niques would  not  seen  to  be  attractive  for  this  class  of  problems. 

We  now  consider  factors  affecting  the  i^cheduling  of  solution 
priorities.  The  tightness  of  the  primary  relaxation  is  generally  a 
function  of  x^,  vrtiich  Is  Itself  a function  of  the  varying  right  hand 
side.  It  is  easy  to  see  that  is  e»n  upper  bound  on  v(Pj^)  - v(P)  , 

euid  that  this  upper  bound  varies  from  c^  - e to  0 (for  e > 0)  for  suit- 
able values  of  the  right  hwd  side.  So  the  gap  value  fluctuates  up  and 
down  (since  r varies)  with  respect  to  the  right  hand  side,  making  it 
difficult  to  capitalize  on  the  behavior  of  the  gap. 

The  behavior  of  the  individual  integer  variables  in  ein  optimal 
integer  solution  seems  to  be  rather  stable  for  the  vast  majority  of 
variables.  This  can  be  seen  by  the  consistent  pegging  of  variables  to 
0 or  1 as  the  right  hand  side  varies.  In  general,  computational  experi- 
ence has  shown  that  variables  with  large  bang-for-bucks  tend  to  be 
pegged  to  1,  and  those  with  small  bang-for-bucks  tend  to  be  pegged  to  0. 
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Variables  with  "average"  bang-for-bucks  tend  to  vacillate  between  0 and 
1 in  optimal  solvtione  as  the  right  hand  aide  is  varied. 

The  persistence  of  pegged  varledsles  (for  varying  right  hwd  sides) 
would  tend  to  support  the  contention  that  scratch  trees  are  rather 
stable  as  the  right  hand  side  varies.  Furthermore  if  the  bremch  varl- 
2d>le  Is  always  chosen  to  be  the  free  variable  with  the  largest  bang- 
for-buck  (as  In  Algorithm  A)  , then  since  the  bang-for-buck  ordering 
remains  the  same,  the  selection  of  branch  variables  should  remain  sta- 
ble. This  line  of  reasoning,  of  course,  simply  reinforces  the  conten- 
tion that  scratch  trees  remain  stable. 

Three  different  solution  approaches  for  1)  were  tested,  all  of 
which  used  Algorithm  A as  a primary  building  block.  First,  a serial 
approach  utilizing  em  adv2mced  initial  separation  was  attempted. 
Algorithm  B; 

1.  Set  k « 1.  Solve  (Pj^)  by  Algorithm  A getting  an  optimal  solution 

X*. 

2.  If  wx*  < B - t,  , , X*  is  optimal  for  (P,  ,)  so  let  k •=  k + 1 and 

— k+1  k+1 

return  to  the  beginning  of  this  step. 

3.  Set  k = k + l.  Ifk>K,  stop. 

4.  T ae  a feasibility  recovery  technique  to  find  a good  feasible  solu- 
tion for  (Pj^)  • Call  it  x*  and  the  corresponding  objective  value, 

z*. 

5.  Perform  steps  2-7  of  Algorithm  A for  (Pj^)  • 

6.  Using  the  frontier  of  fathomed  nodes  (from  (P^^  where  pegged 
variables  from  steps  2-7  of  Algorithm  A are  eliminated)  as  an 

initial  separation  (or  candidate  list)  , perform  steps  9-18  of 
Algorithm  A.  Go  to  2. 
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Th«  test  in  step  2 Is  an  application  of  Theorem  3.  Step  5 employs 
the  pegging  testa  of  Algorithm  A.  In  step  6 the  initial  candidate  list 
used  may  be  descrihad  as  follows  (see  figure  below) . 


scratch  tree  for  (P^^)  "reduced"  scratch  tree 


Initial  Candidate  List  for  (P^) 


(P 

(P 

(P 

(P 

(P 

(P 


’‘l  “ *3  ' ’‘s  “ ’‘e  ‘ *7 


X X 

1 3 


1,  Xg  . - Xg 


0) 

0) 


Xi  = X3  = X?  - 1,  Xg 

*1  “ ’‘s  “ *6  “ 


0) 


Xj^  = 1,  Xg 

X,  = 0) 


0) 


In  this  figure  a vertical  line  denotes  a variable  pegged  to  0 or  1 , and 
a horizontal  line  uenotes  the  automatically  fathomed  alternate  branch. 
The  candidate  list  may  he  ordered  in  step  6 by  the  most  promising  relax- 
ation value.  In  other  words,  when  a candidate  problem  is  fathomed  in 
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(Pj^) , say,  it  is  stored  along  with  its  relaxation  value,  say  v(CPj^). 
Then  for  (P^)  these  candidate  problems  are  investigated  in  decreasing 
ord(!r  of  relaxation  value. 

The  reduced  scratch  tree  is  found  by  simply  eliminating  the  top  of 
the  scratch  tree  which  consists  of  pegged  variedsles  resulting  from  the 
pegging  tests  of  steps  2-7  of  Algorithm  A.  This  is  done  since  in  gen- 
eral these  pegged  variables  comprise  upwards  of  60%  of  the  total  number 
of  variables  in  the  problem,  and  as  a result  the  frontier  of  fathomed 
nodes  becomes  rather  large.  By  using  the  reduced  scratch  tree,  the 
frontier  is  reduced  significantly.  Clearly  the  reduced  frontier  is  a 
valid  initial  separation  for  (P^) . The  reasoning  for  this  approach  is 
twofold.  First,  in  removing  the  pegged  variables  from  the  scratch 
tree  for  (P^^)  it  is  assumed  that  having  pegged  a variable  in  (P^)  , that 
same  variable  may  be  pegged  ff  r (P2) • Second,  in  using  the  reduced 
frontier  it  is  assumed  that  U e unfathomed  nodes  in  the  reduced  tree 
for  (P^)  will  remain  unfathoried  for  (P2^*  shoxild  also  note  that 
occasionally  "automatic"  fathoming  occurs  for  problems  in  the  initial 
candidate  list.  For  inst.mce,  consider  the  candidate  problem 

(p|x  = x = y.  = 1,  x = X = 0).  Now  if  x is  pegged  to  0 in  (P  ) , 

1 3 8 6 7 8 2 

then  this  (CP)  is  fathorried  by  infeasibility.  It  is  also  clear  that  a 

candidate  problem  may  be  fathomed  if  Z w^  > B - tj^. 

iiXj^  set  to  1 

A second  solution  priority  is  the  lexicographically  serial  method. 
Algoritlim  C: 

1.  Perform  steps  2-7  of  Algorithm  A for  (Pj^)  » = 1,...,K  getting 

(x*)j^  and  z*. 

2.  If  an  optimal  solution  has  been  found  for  a (Pj^)  remove  that  index 
k from  further  consideration. 
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3.  Initialize  the  candidate  list  to  consist  of  (I^)  > ” l>...rK 

where  (I^)  is  the  reduced  knapsack  in  step  7 of  Algorithm  A for 
(Pj^)  . Individual  incunib<snt  valuos  are  denoted  by  z*. 

4.  Set  k ■ 1. 

5.  Stop  if  the  candidate  list  is  enqpty:  optimal  solution 

amd  z*  is  the  optimal  vedue  for  k > 1/...,K. 

)> 

6.  If  k > K,  set  k ■ 1.  Select  a c£mdidate  problem  (CPj^)  by  a LIFO 
rule.  That  is,  choose  the  last  cemdidate  problem  in  the  list 
which  has  a "k"  subscript. 

7.  Solve  (CPj^)  getting  ein  optimal  solution  x. 

8.  If  (CPj^)  is  infeasible,  set  k » k + 1 ^md  go  to  5 . 

9.  If  v((CPj^))  , set  k • k + 1 and  go  to  5 . 

10.  If  an  optimal  solution  of  (CPj^)  is  feasible  in  (CPj^)  » 9°  to  14. 

11.  Choose  that  which  is  the  free  variatble  in  (CPj^)  with  the  larg- 
est b^ulg-for-buck. 


12.  If  w,  < B - t , - I w. 

-I  — V J. 


i:Xj^  set  to  1 in  (CPj^) 

h = k,...,K  to  the  candidate  list,  add  the  restriction  x.  = 1 to 

3 

(CPj^)  , h = k,...,K,  and  go  to  11.  Otherwise  go  to  13. 

13.  If  V/.  > B - t - Z Wj^  , add  the  restriction  x,=  0 

^ i:xj^  set  to  1 in  (CPj^)  ^ 

to  (CP,  ) , h * k, . . . ,K,  add  (CP,  lx . = 1)  , h = k+1, . . . ,K  to  the 
h " 3 

ceindidate  list,  choose  that  x.  which  is  the  free  variable  with 

3 

the  largest  bang-for-buck,  and  go  to  the  beginning  of  this  step. 
Otherwise  go  to  7. 

14.  A feasible  solution  to  (P.)  has  been  found.  Set  z*  a v(CP  ), 

K K k 

(x*)j^  = X,  k = k + 1,  and  go  to  5. 

In  step  2 the  reduction  method  is  applied  to  all  K problems.  Steps 


, then  add  (CP^^Ix^  = 0)  , 
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3-14  are  a modification  of  steps  8-18  or  Algorithm  A.  Basically,  the 
procedure  is  to  concentrate  on  (P^)  in  fathoming  tests  emd  brwching 
criteria  until  fathoming  occurs  at  a given  node.  Then  at  that  node 
fathoming  tests  and  branching  criteria  are  applied  to  (P^) . This  con- 
tinues until  all  K problems  have  been  fathomed,  at  which  point  back- 
tracking occurs,  and  concentration  of  fathoming  and  branching  at  a node 
transfers  back  to  that  (P^^)  with  the  smallest  index  k which  has  not  yet 
been  fathomed  at  the  new  node  under  consideration.  Two  advemtages  of 
such  an  approach  are  the  avoidance  of  excessive  storage  of  nodes,  and 
economies  in  the  reoptimization  from  (CPj^)  to  • Two  disadvem- 

tages  are  that  2ui  optimad  solution  for  (P^^)  is  n^^'  always  known  for  use 
in  feasibility  recovery  techniques,  amd  the  mo*  onicity  test  for  opti- 
mality cauinot  be  applied  since  there  is  no  pr  .dained  order  for  find- 
ing optimal  solutions  for  (Pj^) » k 1,...,K. 

A third  approach  is  a serial  method  where  each  problem  is  solved 
from  scratch.  The  only  links  between  problems  are  the  monotonicity 
test,  and  the  feasibility  recovery  technique.  This  approach  could  be 
thought  cr  as  the  traditi-  nal  approach. 

Algorithm  D; 

1.  Set  k = 1. 


2.  Solve  (Pj^)  by  Algorithm  A,  getting  x*. 

3.  If  wx*  ^ B - X*  is  optimal  for  • set  k = k + 1 and 

return  to  the  beginning  of  this  step. 

4.  Set  k=k+l.  Ifk>K,  stop. 

5.  Use  a feasibil<cy  recovery  technique  on  x*  to  get  a feasible  solu- 
tion for  (Pj^)  . Go  to  2. 
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A fourth  approach,  which  was  not  tested  computationally,  is  the 
(oir.jllel  method.  An  algorithm  incorporating  this  method  is  very  simi- 
lar to  Algorithm  C.  Steps  1-5  arc  identical.  That  is,  the  pegging 
tests  for  all  problems  are  done  before  the  branch  and  bound  procedure 
begins.  In  the  branch  and  bound  procedure  (steps  6-14  of  Algorithm  C) 
at  any  given  node  in  the  tree,  is  solved  for  all  problems  which 

have  not  been  fathomed  at  a predecessor  node.  All  fathoming  tests  are 
applied  to  each  of  these  candidate  problems.  A branch  variable  is  then 
chosen  based  on  one  particular  unfathomed  candidate  problem,  and  Ccindi- 
date  problems  for  each  unfathomed  candidate  problem  are  added  to  the 
candidate  list.  Of  course  if  all  candidates  are  fathomed  at  a given 
node,  breinching  does  not  occur.  This  approach  was  not  tested  computa- 
tionally since  it  is  very  similar  to  Algorithm  C,  and  since  in  general 
more  candidate  problem  relaxations  would  have  to  be  solved  in  this 
approach. 

Computational  results  for  the  first  three  approaches  are  given  in 
Table  D.  Ten  different  knapsacks  of  50  variables  each,  and  ten  differ- 
ent knapsacks  of  100  variables  each  were  tested.  Problem  data  was  gen- 
erated randomly  as  explained  earlier.  For  each  knapsack,  5 right  hand 
sides  were  selected  by  reducing  each  succeeding  right  hand  side  by  1% 
for  the  50  varicible  problems  and  .5%  for  the  100  variable  problems.  It 
is  readily  seen  that  Algorithm  D dominates  Algorithms  B and  C by  a con- 
vincing margin,  and  that  its  behavior  timewise  is  very  stable.  The 
other  approaches,  while  occasionally  approaching  the  times  of  Algorithm 
D,  had  a much  larger  variance  in  computation  time.  Reasons  for  the 

superiority  of  Algorithm  D are  twofold.  First  is  the  effort  expended  in 
bookkeeping  and  setup  costs  for  Algorithms  B and  C.  In  general  these 
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costs  outweighed  the  actueul  algorithmic  calcul  itions.  A second  factor 
is  that  the  in^lementation  of  the  LP  optimization  in  Algorithm  D is 
very  efficient  whereas  the  LP  optimization  in  Algorithms  B and  C re- 
quires more  effort.  In  Algorithm  D the  LP  ortimization  is  performed 
only  over  variables  with  an  index  larger  than  some  value.  Also  by  con- 
struction, these  variadsles  are  all  "free"  variables.  That  is,  checking 
if  a variable  has  been  previously  set  to  0 or  1 is  not  required.  In 
Algorithms  B and  C,  however,  the  LP  optimization  must  be  performed  over 
all  variables  and  checks  must  be  made  to  ascertain  whether  a variaible 
is  free  or  not.  These  two  factors  would  seem  to  be  the  major  causes  of 
tho  increased  computation  times.  As  further  confirmation  of  Algorithm 
O's  dominance,  we  appeal  to  the  Remark  in  Chapter  IV  which  in  essence 
establishes  an  upper  bound  on  the  savings  which  can  be  achieved  by 
using  Algorithms  B auid  C instead  of  Algorithm  D.  By  coupling  this 
bound  with  the  additional  bookkeeping  and  optimization  costs  alluded 
to  earlier,  we  have  some  indication  of  why  Algorithms  B and  C failed 
to  perform  as  well  as  Algorithm  D.  We  note  however  that  it  is  entire- 
ly possible  that  results  could  prove  to  be  different  if  solution  methods 
of  recent  years  (now  obsolete)  had  been  used  as  the  primary  building 
blocks  for  a pareunetric  right  hcind  side  knapsack  algorithm. 

It  should  be  noted  that  ordering  the  right  hand  side  values  in 
ascending  or  descending  order  is  not  overly  important,  except  in  the 
case  where  the  change  from  one  right  hand  side  to  the  next  is  ve.-y 
small.  In  such  a case  there  are  advantages  to  both  orderings.  If  the 
largest  right  hand  side  problem  is  solved  first,  then  the  optimal  solu- 
tion may  remain  feasible  for  the  next  smaller  right  hand  side,  and  by 
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monotonicity  its  explicit  solution  may  be  avoided.  If  th(*  smallest 


right  hand  side  is  solved  first,  then  the  optimal  solution  value  may  be 
an  excellent  lower  bound  for  the  next  larger  right  hand  side.  On  bal- 
ance it  would  appear  that  the  potential  savings  would  be  greater  if  the 
largest  right  h^md  side  problem  were  solved  first.  It  is  interesting 
to  note  that  the  feasibility  recovery  technique  (step  5 of  Algorithm  D) 
was  not  effective.  Computation  times  were  better  when  step  5 was  de- 
leted. The  major  reason  for  this  is  that  the  feasible  solution  genera- 
ator  for  (Pj^)  oenerally  gave  a better  solution. 

Finally,  we  mention  that  a tradeoff  point  exists  for  solving  1)  by 
Algorithm  D as  opposed  to  DP.  Horowitz  and  Sahni  [1974]  have  devised  a 
DP  algorithm  which  effectively  splits  the  knapsack  problem  into  two 
separate  problems  each  being  one  half  the  size  of  the  original  problem. 
This  allows  savings  not  only  in  Stonge  but  in  computation  time  as  well. 
Whiile  this  approach  is  slower  than  Algorithm  A for  (P)  , it  does  possess 
the  property  that  optimal  solutions  for  all  right  hand  sides  1,2,...,B 
are  found  as  a by-product.  It  follows  that  as  K increases  in  1)  , the  DP 
approach  becomes  more  attractive.  Using  a correction  ratio  of  8:1  for 
computation  times  on  the  IBM  370/165  as  compared  to  the  IBM  360/91,  we 
estimate  (using  HS's  results)  that  the  breakpoint  for  a 50  var.LabJe 
knapsack  is  in  the  range  of  12  right  hand  sides.  That  is,  if  K > 12 
for  1),  then  the  DP  approach  becomes  more  attractive.  However,  as  the 
nianber  of  variables  increases,  DP  solution  times  increase  markedly. 

For  example,  using  HS's  results  again,  the  breeOepoint  is  22  right  hand 
sides  for  a 60  variable  knapsack. 
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C . The  0-1  Knapsack  Problem  with  a Finite  Number  of  Objective  Functions 

In  this  section  we  consider  problem  2) . In  this  PILP  the  feasible 
region  remains  constant,  while  the  objective  function  varies.  Basical- 
ly, Algorithms  B,  C,  and  D remain  the  same  with  two  exceptions.  Call 
the  modified  algorithms,  B',  C*  , and  D*.  First,  the  feasibility  recov- 
ery technique  is  modified  to:  for  x*  optimal  in  (Pj^) » x*  is  feasible 

in  (P,  ,)  with  value  (c  + f,  ,)x*.  Second,  the  variables  must  be  re- 

k+1  k+1 

ordered  by  descending  bang-for-buck  for  each  problem.  Wniie  or.?  may 
think  that  this  reordering  is  unin^xjrtemt  coinputation£dly,  we  shall  see 
that  sort  time  is  actually  a substantial  part  of  total  computation  time. 

Algorithms  B'  and  C*  were  not  tested  for  this  parameterization 
because  of  the  poor  performeuice  of  Algorithms  B and  C for  problem  1)  . 

The  reasoning  used  in  discarding  these  cd.gorithms  is  threefold.  First, 
the  computer  implementation  is  quite  similar  to  that  used  for  1).  Thus, 
since  bookkeeping  and  setup  costs  took  much  of  the  computation  time  in 
Algorithms  B and  C,  it  is  clear  that  such  would  be  the  case  for  B'  and 
C'  also.  Second,  the  feasibility  recovery  technique  was  ineffective 
for  2).  This  paralleled  the  ineffectiveness  of  the  feasibility  recov- 
ery technique  for  1).  Third,  scratch  tree  stability  is  worse,  general- 
ly, for  2)  than  for  1).  "’his  follows  since  in  the  branch  and  bound 
procedure  employed,  branch  variables  are  always  chosen  by  best  bang- 
for-buck.  Thus  in  1) , the  branching  remains  stable  since  the  bang-for- 
buck  ordering  remains  the  same.  However,  in  2)  this  ordering  generally 
changes  from  (P^^)  to  We  conclude,  then,  that  Algorithm  b'  dom- 

inates B'  and  C . 

Algorithm  D'  was  coded,  and  test  problems  were  run.  Problems  were 


59 


yenerated  as  explained  earlier  with  the  additional  objective  functions 
randomly  generated  from  the  original  objective  function  as  follows. 

One  third  of  the  cost  ct^efficients  were  varied  by  ±10%,  one  third  by 
+5%,  cind  one  third  remained  the  same.  It  is  interesting  to  note  (even 
in  the  absence  of  comparison  algorithms)  that  in  the  100  varieusle  prob- 
lems, sort  time  consumed  some  40%  of  total  computation  time.  See  Table  E. 

Finally,  we  note  that  use  of  a DP  algorithm  for  2)  would  require 
K separate  applications.  Since  Algorithm  A dominates  the  best  DP  algo- 
rithm, Algorithm  D*  would  dominate  it  as  well. 

D . The  0-1  Knapsack  with  a Continuous  Objective  Function  Parameteriza- 
tion 

In  this  section  we  consider  problem  3) . This  problem  may  be 
thought  of  as  finding  optimal  solutions  for  all  possible  weightings  of 
two  criteria.  For  exan^le,  in  a capital  budgeting  problem,  management 
may  be  interested  in  maximizing  some  combination  of  net  present  value 
and  of  pay  back  over  the  first  three  years  of  a project. 

From  Theorems  5 eind  8 we  know  that  v(Qp)  is  piecewise  linear  and 
convex,  and  that  it  is  possible  to  deduce  optimality  over  a range  of  6 
by  verifying  optimality  at  certain  values  of  6.  CXir  procedure  uses 
Algorithm  A as  a major  building  block. 

Algorithm  D": 

1.  Set  0=0. 

2.  Solve  (Q  ) by  Algoritnin  A getting  an  optimal  solution,  x*(6).  For 

6 

each  feasible  solution,  x(e),  which  is  found,  add  the  straight 

line  (c  + ef)x(0)  to  LB(9)  (the  convex  lower  bound  function  for 

v(e))  . 
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3.  If  6 ■ 0,  set  0 ■ 1 and  go  to  2. 

4.  Check  whether  x*(6)  can  be  deduced  to  be  optimal  over  some  zange 
of  0.  If  optimal  solutions  have  been  found  for  V 0 e (0,1],  stop. 
Otherwise  go  to  5. 

5.  Choose  a new  value  of  0 which  is  a bre^d^point  of  LB(0)  , which  has 
not  been  proven  to  be  optimal,  and  which  is  closest  to  the  previ- 
ous value  of  0.  Go  to  2. 

This  algorithm  relies  on  building  up  a lower  bound  function  for 

v(Qa)  solving  (Q  ) at  the  end  points,  e = 0 and  0*1.  Then  utiliz- 
0 0 

ing  the  power  of  Theorem  8,  the  next  value  of  6 is  taken  to  be  a break- 
point of  LB(0)  which  is  closest  to  the  old  value  of  0,  and  which  has 
not  been  proven  optimal  as  yet.  This  particular  point  is  chosen  for 
three  reasons.  First,  the  value  of  LB(0)  is  likely  to  be  a good  feas- 
ible solution  for  (Qg) • Second,  reoptimization  methods  (when  en^loyed) 
are  more  efficient,  in  general,  for  a value  of  0 close  to  the  previous 
value.  Third,  by  choosing  a breakpoint  of  LB(0'/  the  potential  for  de- 
ducing optimality  over  a range  of  0 is  greater. 

Computational  results  are  shown  in  Table  F.  Each  component  of  f 
was  rcuidomly  generated  by  a uniform  distribution  U[10,100]  which  had  a 
50%  correlation  coefficient  with  the  corresponding  c^.  Note  that  the 
number  of  values  of  0 for  which  (Qq)  is  solved,  is  generally  slightly 
less  than  twine  that  of  the  number  of  optimal  solutions  found  for 
V 0 e (0,1].  This  suggests  that  the  method  for  choosing  the  next  value 
of  0 is  quite  effective.  Also  note  that  sort  time  for  the  100  variable 
problems  comprises  about  40%  of  total  computation  time. 
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Tabla  A 


Conipari:3on  of  HS  Algorithm  and  Algorithm  A Omitting  Steps  1-7 
(Time  in  milliseconds  excluding  I/O  and  sort  time 
on  an  IBM  360/91) 


Problem 

Identifier 

Number  of 
Variables 

HfiS 

Algorithm  A 
Omitting  Steps  1-7 

1365 

50 

6 

4 

1397 

50 

8 

5 

1398 

50 

8 

6 

1326 

50 

12 

8 

1406 

50 

7 

5 

1366 

50 

16 

11 

1282 

50 

7 

5 

1340 

50 

15 

9 

1288 

50 

9 

7 

Total  for  9 problems 

98 

67 

Average  for  9 problems 

10 

7 

Table  B 

Computation  Time  In  Hilliaeconds  for  Algorithm  A 
(excluding  sort  and  I/O  time  on  an  IBM  360/91) 


Number  of  % 

Reduction 

Problem 

Variables  In 

Steps  1-7 

1365 

50 

88 

1397 

50 

82 

1346 

50 

62 

1326 

50 

56 

1406 

50 

82 

1366 

LO 

58 

1282 

50 

80 

1340 

50 

82 

1288 

50 

78 

1468 

50 

86 

Total 

Average 

75 

2823 

100 

89 

2772 

100 

65 

2763 

100 

67 

2945 

100 

88 

2795 

100 

99 

2706 

100 

85 

2589 

100 

99 

2992 

100 

95 

2447 

100 

94 

2771 

100 

86 

Total 

Average 

87 

5531 

200 

86 

5790 

200 

79 

5423 

200 

94 

5641 

200 

99 

5614 

200 

90 

5536 

200 

94 

5108 

200 

93 

5274 

200 

95 

5448 

200 

92 

5734 

200 

93 

Total 

Average 

92 

Tims  for 
Steps  2-7 


Time  for 
Steps  8-18 


Total 

Time 


Comparison  of  Algorithms  B,  C,  D for  the  Kne^sack  Problem  with  5 Right  Hand  Sides 
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Table  D (continued) 
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Table  E 


Algorithm  D'  (Traditional)  for  the  Knapeaclc  Problem  with  10  Objfctive 
Functions.  (Time  in  milliseconds  excluding  I/O  but  including 

sort  on  an  IBM  360/91) 

Nvmber  of 
Problem  Variables 

Sort 

Time 

Time 

Excluding  Sort 

Total 

Time 

1365 

50 

26 

39 

65 

1397 

50 

26 

36 

62 

1348 

50 

27 

57 

84 

1326 

50 

27 

72 

99 

1406 

50 

27 

52 

79 

1366 

50 

27 

73 

100 

1282 

50 

26 

39 

65 

1340 

50 

26 

60 

86 

1288 

50 

25 

62 

87 

1468 

50 

26 

44 

70 

Total 

263 

534 

797 

Average 

26 

53 

80 

Average/objective  3 
function 

5 

8 

2823 

100 

61 

78 

139 

2772 

100 

64 

75 

139 

2763 

100 

60 

83 

143 

2945 

100 

61 

62 

123 

2795 

100 

60 

74 

134 

2706 

100 

62 

84 

146 

2589 

100 

61 

62 

123 

2992 

100 

61 

78 

139 

2447 

100 

62 

118 

179 

Total 

552 

714 

1266 

Average 

61 

79 

141 

Average/objective  6 
function 
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Total  738  1109  1847  102  55 

Average  74  111  185  IJ  5.5 


VI.  THE  PARAMETRIC  GENERALIZED  ASSIGNMENT  PROBLEM 


Consider  the  problem: 


min 

Xij.0,1 

I 

iel 

Z 

jeJ 

C.  .X.  . 

ID  ID 

r 

jeJ 

r.  .X. . < b. 

ID  ij  - 1 

V ^ e I 

E 

iel 

X.  . ■ 1 
iD 

V j •.  J 

where  c.  . >0,  r.  , >0,  and  b,  > 0.  This  problem  has  been  referred  to 

ID  - 13  1 

as  the  generalized  assignment  problem.  Let  the  index  set  I denote  a 
collection  of  agents,  and  let  the  index  set  J denote  a collection  if 
tasks.  Each  task  j is  to  be  assigned  to  exactly  one  agent,  and  each 
agent  i may  perform  a collection  of  tasks  as  long  as  these  tasks  do  not 
violate  the  agent's  resource,  b^.  The  amount  of  resource  which  agent 

i must  use  to  perform  task  j is  denoted  by  r^ ^ , and  the  cost  to  perform 
the  tcisk  is  denoted  by  c^^.  The  problem,  then,  is  to  assign  each  task 
to  an  agent  such  that  agent  resources  are  not  violated,  and  such  that 
the  total  cost  of  performing  the  tasks  is  minimized. 

Various  real  world  problems  can  be  modeled  accurately  as  gener- 
alized assignment  problems.  These  include  scheduling  variable  length 
television  |'"•.,■mercials  into  time  slots,  assigning  software  development 
tasks  to  computer  programmers , and  scheduling  payments  on  accounts 
which  require  "lump  sum"  payments.  See  Ross  and  Soland  [1974]  for 
other  examples  and  motivations. 

In  this  chapter  we  present  an  efficient  branch  and  bound  algorithm 
(Ross  and  Solcind  [1974])  for  (A)  which  utilizes  a Lagrangeeui  relaxation 
as  the  primary  relaxation.  Thus  a linear  programming  relaxation  is  not 
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required.  After  this  we  consider  three  parameterizations  of  (A)  , namely: 
4)  For  k = solve: 


min  E E 

x^j-0,1  iel  jeJ 

E 

jeJ 

^i j*i j 1 ^ 

E 

iel 

Xij  = 1 

For  k = 1, . . . ,K  solve: 

min  E 

^ij“0/l  iel 

E 

jeJ 

(c,  . + f . .. 
iD  iDk 

E 

jeJ 

r.  .X.  . < b 
ID  ID  - ■ 

E 

iel 

X,.  .1 

For  V 0 e [0,1]  solve: 

min  E 

X.  .=0,1  iel 

ID 

E 

jeJ 

E 

r.  .X.  . < b 
ID  ID  - ■ 

jeJ 

V j e J 


V i £ I 

V j e J 


X.  . = 1 
ID 


V i e I 

V j e J 


where  h.,  , f . , and  f . . are  scalars, 

ik  13k  ij 

Algorithms  are  presented  for  4),  5),  and  6),  computational  results 
are  given,  and  conclusions  are  drawn  regarding  the  most  efficient 
algorithms  for  each  parameterization. 

A.  An  Algorithm  for  the  Generalized  Assignment  Problem 


Ross  and  Soland  [1974]  present  an  efficient  brcinch  cind  bound 
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algorithm  for  (A)  which  does  i.ot  use  linear  programming  as  the  primary 
relaxation.  Rather,  a relaxation  is  used  which  requires  the  solution 
to  a number  of  0-1  knapsack  problems.  We  present  a variant  of  their 
approach  utilizing  the  concept  of  Mgrangean  relaxation  (Geoffrion 
[1973])  . 


Before  stating  the  algorithm,  the  primary  releucatiun  will  be 
developed.  Consider  the  relaxation  of  (A)  • 


(LGR^) 


min 

X. .=0,1 
i: 


E Z 
id  jeJ 


c.  .X. . 

ID  i] 


Z 

id 


X.  . = 1 
ID 


V j e J. 


This  relaxation  singly  ignores  the  agents'  resource  constraints,  or 

equivalently  a vector  6 = 0 is  assigned  to  these  constraints,  and  the 

term  Z 6.  ( Z r.  .x.  . - b.)  is  placed  in  the  objective  function.  Thus 
iel  ^ jeJ  ^ ^ 

(IGR^)  may  be  solved  as  a special  linear  program  by  replacing  x^^=0,l 
by  0 x^j  5.  1 ' It  is  obvious  that  an  optimal  solution  to  the  linear 


program  (LGR^^)  is  an  integer  solution  which  satisfies  the  constraint 

GUB 

x^j=0,l  . Call  this  solution  x . It  is  also  easy  to  see  thau 


optimal  dual  multipliers,  , for  (LGR^)  lie  anywhere  in  the  range 
[c.  . ,c , .]  where  c.  .is  the  smallest  c,  . in  column  j,  and  c,  .is 

the  second  smallest  c^^  in  column  j.  A second  (and  generally  tighter) 
relaxation  is: 


min  ( Z Z 

X.  .=0, 1 iel  jeJ 
ID 


jeJ 


c. .X.  .)  ♦ Z A . (1 
jd  ^ 


Z X.  .) 


id 


ID 


r .X,  . < b. 
ID  ID  - 1 


Vie  I, 
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which  is  equivalent  to: 


Z X - max 
jeJ  ^ 


(LGR^) 


jeJ  id 


jcJ 


(X  . - c,  , )x 
3 13  ij 


r..x..  <b.  Viel 
13  ij  - 1 


where  X . is  chosen  to  be  equcl  to  c.  . V j e J . Note  that  this 
3 ^2^ 

problem  r.epcirates  on  I into  jl|  independent  0-1  knapsacks.  Also  it  is 

GUB 

clear  that  all  varicibles  which  are  equal  to  0 in  x may  be  set  to  0 
in  an  optimal  solution  to  (LGR^)  • This  follows  since  it  is  assumed 
that  r^j  > 0,  cuid  since  the  corresponding  cost  coefficient  (X^  - c^ J 
is  less  thcin  or  equal  to  0.  Thus  over  all  jll  knapsacks  there  are  a 
total  of  only  |j(  free  varicibles.  An  optimal  solution  to  (LGR2)  will 

c.  in  LGR 

be  called  x 

After  introducing  some  additional  notation,  a branch  and  bound 

algorithm  will  be  stated.  Let  S be  the  set  of  variables  in  a partial 

solution.  In  other  words,  S = { x,  , I x.  . is  assigned  a value  of  0 

13  ' 13 

or  1 } . Let  Jp  = { j I j e J and  ? ■ 1 for  x^^  e :3  } . Let  (A) 

be  as  given  earlier  and  let  (B)  be: 


I min 

1 ■ ^ J 


(B) 


X.  .eS 

13 


X,  =0,1 

13 

X.  .^S 

ID 


iel  jeJ, 


I 

id 


c , .X  , . 

ID  13 


X . . 

13 


= 1 V j e J, 


X . ./^S 

ID 


Let  (C)  be: 
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(C) 


^ c.  .X.  , + Z A.  - m^uc  Z Z (A  - c,  ,)x 

x.cs  ‘3  « ^ x,.0,l  jd  id  i 

xijts 

ID 

Vil ‘-^i 


X.  .Jts 

13 


fc=i 


Let  (C)  be  (C)  with  *0,1  replaced  by  0 ^ • 

Algorithm  E: 

1.  Initialize  Uva  candidate  list  to  consist  of  (A),  eind  let  z*  be  a 

large  number.  Set  S * 0 and  J = J. 

F 

2.  stop  if  the  Ceuididate  list  is  empty:  if  there  exists  an  incumbent, 
then  it  is  an  optimal  solution  for  (A) , otherwise  (A)  has  no 
feasible  solution. 

3.  Select  a candidate  problem  (CP)  from  the  camdidate  list  using  a 
LIFO  rule. 


GUB 


4.  Solve  (B)  for  this  candidate  problem  and  get  a soxUtioi  x 

v(B)  ^ z*  or  no  feasible  solution  is  found,  go  to  2.  If 
jjGUB  D^ij  J j^g  feasible  in  (A),  go  to  9.  Otherwise,  find 


If 


S_ 


ID 


a vector  A,  each  component  of  which  corresponds  to  a j € J , 

r 

where  A.  is  chosen  to  be  the  second  smallest  c,  . in  column  i 
D ID 

A 

such  that  x^j/!(S.  If  a A?  does  not  exist  for  some  j £ Jpf 

CTIR 

set  i*  = {i|x^c  = 1},  and  go  to  11. 

5.  Solve  (C)  . If  v(C)  ^ z*,  go  to  2. 

LiGR 

6.  Solve  (C)  cuid  get  a solution  x . If  v(C)  ^ z* , go  to  2. 

■7  m LGR  ^ MOD  MODm  ,|i  , . ^ 

7.  Try  to  modify  x to  x so  that  x ('^x,  ,)  is  feasible 

S 

in  (A)  , and  such  that  the  corresponding  objective  function  value 
is  equal  to  v(C) . If  successful,  go  to  10. 
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8.  SopardLo  (CP)  into  two  new  problems  by  binding  that  variable 
which  satisfies: 
t _ . ^ = max 


i*j* 


X. . =1 

£oi 

If  there  is  a tie,  break  it  arbitrarily.  The  new  problems  are 
placed  in  the  ccindidatc  list  in  the  order  (CP|x.*.  . = 0)  and 

J ^ 

(CPjx..  ..  = 1).  Update  S emd  J_  for  each  new  problem.  Additional 
1*  j * F 

variables  may  be  assigned  to  0 in  (CPlx^^j^  ■ 1)  : a)  ® 


if  i ^ i*  and  j*  i S;  b)  x^*^  = 0 if  x. 


* " ”i*j  i*j  ^ ® i*j 


cind  r . . . > 


. E r..  .X..  . for  i j*.  Update  S,  and  go  to  2. 

* ^ 1*1  1*1 
x...eS 
1*3 


b.*  - 
1 


^ MOD  GUB 

9.  Set  v(C)  = v(B)  eind  x = x . 

10.  An  improved  feasible  solution  for  (A)  has  been  found.  Record 

this  solution  as  the  new  incumbent,  x*  = x^^  U(M  x.  ,)  and  set 

S 

2*  = v(C) . Go  to  2. 

11.  Add  the  problem  (CP|x^^?  = 1)  to  the  candidate  list.  Update  S 

and  Additional  variables  may  be  set  to  0:  = 0 if 

r . ^ . X _ . for  j 3 . Update  S , 
i*j  1*3 


X.  . . ^ S and  r . . . > b.  . - 
1*3  i'3  1* 

and  go  to  2 . 


X.  . .eS 
1*3 


In  step  4,  (B)  is  solved  and  the  usual  fathoming  tests  are 
employed.  If  all  fathoming  tests  fail,  an  attempt  is  made  to  tighten 
the  relaYcition  Ly  solving  (C) . However  if  some  X?  , j e J_  does  not 
exist,  this  implies  that  only  one  agent  i*  is  available  to  handle  task 
j . Hence,  may  be  pegged  to  1 in  step  11.  As  a result  of  this 

peg  to  1,  additional  variables  may  be  pegged  to  0,  thus  hopefully 
tightening  the  relaxation  even  further.  If  a peg  to  1 is  not  possible, 
and  all  fathoming  tests  for  (C)  fail,  then  (C)  is  solved  in  step  6. 
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I 


Note  that  Algorithm  A is  used  to  solve  each  individual  knapsack.  Of 

GUB 

course,  the  knapsack  algorithm  need  not  be  used  for  agent  i if  the  x’ 
solution  does  not  violate  that  agent's  resource.  In  step  7,  tasks 


which  are  not  assigned  in  the  solution  to  (C)  (this  occurs  since  the 
1 x,,  = l VjeJ  constraints  have  been  relaxed)  are  reassigned  to 


the  available  agent  with  the  second  smallest  cost.  If  all  such  tasks 
are  reassigned,  cind  the  knapsack  constraints  are  satisfied,  then  this 
modified  solution  is  feasible  and  heis  an  objective  value  precisely 
equal  to  v^C).  Thus  a new  incumbent  is  generated.  In  step  8 when  all 
fathoming  tests  fail,  branching  must  occur.  The  branching  criteria 
uses  a weighted  penalty  for  not  choosing  an  agent  i*  to  perform  a task 
j*  multiplied  by  the  current  amount  of  resource  available  to  agent  i*. 
Note  also  tha’'  the  ordering  of  the  new  candidate  problems  in  the 
candidate  list  is  such  that  the  = 1 branch  is  investigated  first. 

Computational  results  are  presented  in  Table  G.  The  50  variable 

problem  is  taken  from  Ross  and  Soland  (1974) . The  nine  versions  differ 

only  in  the  agent  resources  is  shown.  All  other  test  problems  were 

generated  per  Ross  and  Soland.  The  were  randomly  generated 

with  distributions  0(5,25]  and  U(10,50]  respectively.  Each  b^  was  set 

equaJ  to  "J*|j|/|l|  + .4*{max  Z r..x..}  where  x is  an  optimal 

iel  jeJ 

solution  to  (LGR^).  T)ic  results  in  Table  G show  that  the  algorithm 
is  very  efficient  for  most  problems.  Note  that  our  algorithm  improves 
upon  the  Ross  and  Soland  version  for  the  50  variable  problems  by 
investigating  fewer  nodes  and  solving  fewer  0-1  knapsacks.  Couplod 
with  Ross  and  Solano's  results,  we  conclude  that  the  algorithm  is  an 


r 

«[; 


I 

f 


c. 


1 


t 


I, 

f-: 

S' 

t, 

f 

i- 

i;. 

'li 


order  of  magnitude  faster  than  other  algorithias  such  as  RIP30C  which 
is  a general  purpose  0-1  code,  cind  IPNETG  which  is  a branch  and  bound 
generalized  network  code. 

R . The  General -zed  Assignment  Problem  with  a Finite  Number  of  Right 
Hand  Sides 


In  this  section  we  consider  problem  4)  . By  allowing  the  right  hand 

side  to  vary,  flexibility  is  introduced  into  the  model.  This  allows  the 

analyst  to  examine  the  effect  of  changes  in  agent  resources.  We  begin  a 

formal  amalysis  of  4)  by  investigating  the  problem  dependent  techniques 

of  chapter  III.  Then  the  factors  affecting  the  scheduling  of  solution 

priorities  will  be  discussed,  and  three  algorithms  will  be  presented. 

Finally,  computational  experience  will  be  cited,  cuid  conclusions  d*-  wn 

concerning  the  most  efficient  algorithm. 

The  use  of  reduction  techniques  in  4)  does  not  appear  to  be 

promising.  We  mention  one  such  technique,  and  then  poini  out  its 

shortcomings.  Consider  agent  i and  tasks  and  • Let  ^ 

meix  {b,  - h.,  } . The  value  M,  is  the  maximiom  resource  available 

k=l K " 

to  agent  i over  all  K problems.  Ifr..  + r.  . >M.  , then 

111  ID,  X 


X.  , + X,  . < 1 is  a valid  constraint  for  (P,  ) V k = 1,...,K  . However 


ID- 


"^2  ■ 


the  addition  of  such  a constraint  destroys  the  structure  of  the  pioblem, 
and  consequently  the  solutions  to  various  relaxations  (i.c.  (LCJR^))  are 
no  longer  analytic  in  nature.  The  crux  of  the  situation  is  that  in 
attempting  to  tighten  the  primary  relaxation,  tlie  structure  of  the 
problem  is  destroyed,  and  hence  solution  efficiencies  are  lost.  Thus, 


■4 
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vt'fj'rtr,,,.. 


certain  reduction  techniques  can  actually  complicate  the  problem,  and 
in  fact  their  incorporation  into  an  algorithm  may  retaid  efficiency. 

We  now  consider  feasibility  recovery  tecliniques.  Suppose  that  we 


have  found  a feasible  solution  x for  (P^)  which  is  not  feasible  in 

Further,  suppose  that  not  all  agent  resources  are  violated  by  x in  (P^)  . 

One  approach  is  to  reassign  tasks  from  an  overassigned  (t  rifeasible) 

agent  one  at  a time  such  that  each  reassignment  is  made  at  the  smallest 

additional  cost,  and  such  that  it  is  made  to  an  agent  with  sufficient 

resource  available.  Other  approaches  can  also  be  devised  ad  infinitum. 

Next  are  bounding  problem  reoptimization  techniques.  Suppose  that 

at  a generic  node  in  a branch  and  bound  tree,  (LGR^)  has  been  solved  to 

optimality  for  a candidate  problem  associated  with  (P^^)  . Can  this 

solution  be  reoptimized  efficiently  for  the  candidate  problem  at  that 

node  which  corresponds  to  (p2^^  general  the  answer  is  no.  There 

are  two  reasons  fo."  this.  First,  additional  pegging  of  variables  to 

0 by  ii. feasibility  (as  in  step  8b  of  Algorithm  E)  may  occur  if  resources 

are  reduced  from  (P^^)  to  (P^)  • Conversely  if  resources  are  increased, 

variables  may  r.o  longer  be  pegged  to  0.  Of  course  if  feasibility  pegs 

are  not  enforced,  tnis  reasoning  does  not  apply.  Second,  as  we  have 

seen  in  chapter  V,  solving  closely  related  0-1  knapsacks  is  best 

accomplished  by  solving  them  separately..  We  observe,  however,  that  if 

LGR 

the  change  in  the  feasible  region  is  monotone,  and  x remains  feasible 
LGR  * 

in  (P^)  / then  x is  optimal  for  the  candidate  problem  corresponding 
to  (P,).  i 

Wide  range  bounding  techniques  may  ailso  be  employed.  Once  again 
suppose  that  a candidate  problem  relaxation  associated  with  (P^)  has 
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been  optimized  at  a generic  node.  We  wish  to  calculate  a dual  bound 


for  the  candidate  problem  associated  with  (P2)  at  that  node.  Such  a 
l>ound  may  be  calculated  (cf . chapter  III)  , but  one  must  be  careful  to 


use  "good"  dual  multipliers  in  calculating  the  bound.  (Dual  mul^-ipliers 
are  said  to  be  "good"  if  the  corresponding  Lagrangean  releucation,  which 
uses  these  multipliers,  generates  a tight  bound.)  If  (LGR^)  has  been 
solved  to  optimality,  then  "good"  dual  multipliers  are  not  readily 
available  since  (LGR2)  consists  of  |l|  independent  0-1  knapsac)cs.  It 
is  generally  true  that  deriving  "good"  dual  multipliers  for  an  ILP  is  a 
difficult  task.  Nonetheless,  if  (LGR2)  has  been  solved,  dual  multipliers 
for  the  continuous  relaxation  are  availcible,  and  a dual  bound  may  be 
calculated  for  the  candidate  problem  corresponding  to  (P2)  . 

We  now  turn  to  the  factors  affecting  the  scheduling  of  solution 
priorities.  Tightness  of  the  primary  relcucation  as  a function  of  the 
right  hand  side  can  best  be  explained  by  using  the  formulation: 


min  E E c x.  . 

x.,=0,l  iel  jeJ  ^ 
ij 


E r.  .X.  . < b V i e I 
jeJ  - 


X.  . = 1 V j e J 

13 


where  b is  a non-negative  scalar.  As  b increases,  the  solution  x 

for  (LGR^)  comes  closer  to  feasibility  because  the  knapsack  constraints 

become  less  constraining.  In  fact,  for  a sufficiently  large  value  of 

b,  x^^  is  feasible  in  (S,  ) , and  hence  is  optimal  in  (S  ) . The  rela- 

b D 

tionship  between  v(Sj^)  and  v(LGR^)  is  indicated  in  the  figure  below. 


.(S^l 


V(LGRJ) 


(Note  that  the  graph  will  not  be  continuous,  in  general,  but  is  drawn 
that  way  for  the  sake  of  simplicity.)  By  referring  to  Table  G for  the 
50  variable  problems,  we  see  that  as  the  agent  resources  decrease,  the 
number  of  nodes  investigated  generally  increases.  This  empirical 
behav’or,  when  coupled  with  the  graph  above,  substantiates  the  belief 
that  as  the  tightness  of  the  primary  relaxation  deteriorates,  a problem 
becomes  more  difficult  to  solve  (in  terms  of  the  number  of  nodes 
investigated) . 

The  behavior  of  the  individual  integer  variables  in  an  optimal 

solution  is  difficult  to  categorize  for  this  particular  parameterization. 

As  resources  are  reduced,  some  tasks  may  be  reassigned  to  other  agents. 

However  it  is  not  a simple  matter  to  deduce  which  tasks  are  reassigned. 

The  persistence  of  scratch  trees  as  b varies  seems  to  be  good, 

empirically  speeiking,  for  small  changes  in  the  right  hand  side.  This 

is  because  the  solution  to  (LGR^)  remains  rather  stable,  and  In  the 
Jo 

solution  to  (LGR^)  the  "most  attractive"  variab]es  tend  to  remain  at 
a level  of  1.  Since  the  branching  rule  is  to  branch  on  the  "most 
attractive"  variable  which  is  equal  to  1 in  x ',  the  ordering  of 
potential  branch  variables  tends  to  remain  stable,  and  hence  the  scratch 
trees  remain  stable.  The  cause  of  insteibility  in  general  is  the 


peg'-ji.ng  of  variables  to  0 by  infeasibility.  This  may  cause  x to 


*0 


change,  which  in  turn  changes  x . We  note  that  if  the  pegging  by 


infeasibility  were  not  implemente'*  thei  scratch  trees  would  tend  to  be 
more  stable.  Of  course  this  st^d>illty  is  bought  for  the  price  of 


larger  scratch  trees,  since  fathoming  power  at  a node  is  reduced  when 
the  logical  pegs  to  0 are  not  enforced. 

Next  we  present  three  approaches  for  solving  4) , each  of  which  uses 
Algorithm  E as  a primary  building  block.  The  firs;  is  a serial  approach 
which  utilizes  an  initial  separation  consisting  of  the  fathomed  nodes 
from  the  previous  (P^^)  . 'lecall  that  we  define  (Pj^)  and  to  be 

relatively  monotone  if  r(Pj^)  B approach  is  similar  in 

spirit  to  Algorithm  B of  chapter  V.B  . 

Algorithm  F; 

1.  Set  k = 1.  Solve  (P  ) by  Algorithm  E getting  an  optimal 

K 

solution 

2.  If  k > K,  stop.  If  (Pj^)  and  are  relatively  monotone,  and 

if  e then  is  optimal  in 

k = k + 1,  and  return  to  the  beginning  of  this  step. 

?.  Set  k = k + 1.  If  k > K,  stop. 

4.  Use  a feasibility  recovery  technique  on  to  find  a good 

feasible  solution  for  (Pj^)  . Call  it  and  its  corresponding 

OZjj  ective  value,  z*. 

k 

5.  Use  the  frontier  of  fathomed  nodes  from  as  an  initial 

candidate  list,  and  order  the  list  in  increasing  order  of  optimal 
relaxation  value  calculated  for  the  (CPj^_j^)  problems.  With  this 
ordered  candidate  list  solve  (Pj^)  using  steps  2-11  of  Algorithm  E. 


Go  to  2 . 
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Note  that  under  nvanotonicity,  step  2 may  allow  one  to  avoid  explici 

solution  of  a particular  Step  4 c£ui  be  expanded  to  allow  a 

feasibility  recovery  technique  for  to  t)e  invoked  whenever  a 

feasible  solution  for  (Pj^)  is  found.  This  option  is  incorporated  in 

our  computer  implementation.  In  step  5 if  (Pj^)  and 

relatively  monotone,  it  may  be  possible  to  "automatically"  fathom  a 

candidate  problem  if  v((CPj^_j^))  ^ zjj  • This  follows  since 

v(P  ) > v{P  ).  Also  of  course  an  automatic  fathom  occurs  if 
k — k-1 

I r ,x..  >b.  -h.,  for  some  i e T. 

- i:  1]  1 J-k 


A second  approach  is  lexicographically  sorial  which  is  similar  in 
spirit  to  Algorithm  C in  chapter  V.B. 

Algorithm  G; 

1.  Set  k * 1. 

2.  Initialize  the  candidate  list  to  consist  of  (P  ) V k = 1,...,K. 

Individual  incumbent  solutions  are  denoted  by  and  solution 

values  by  z*.  Set  J = 0,  S = 0 V k = 1,...,K.  Go  to  4. 

K F K 

3.  Set  k = k + 1.  If  k > K,  set  k = 1. 

4.  Stop  if  the  'candidate  list  is  empty:  (x*)  is  an  optimal  solution, 

1C 

and  z*  is  the  optimal  value  (if  they  exist,  otherwise  (P  ) is 

JC 

infeasible)  for  V k = 1,...,K. 

5.  If  k > K,  set  k = 1.  Select  a caiididate  problem  (CPj^)  by  a LIFO 

rule.  That  is,  choose  the  last  candidate  problem  in  the  list 

which  has  a k subscript.  If  none  exists,  set  k = k + 1,  and 

return  to  the  beginning  of  this  step. 

prjri 

6.  Solve  (B)j^  for  this  candidate  problem  and  get  a solution  x^ 

If  v((B)j^)  ^ z*  or  no  feasible  solution  is  found,  go  to  3.  If 


t 
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X X..)  is  feasible  in  (P.)»  go  to  12.  Otherwise,  find  a 

_S  ^ ^ 

vector  A,  each  component  of  which  corresponds  to  a j e J , and 

F 

where  X.  is  chosen  to  be  the  second  smallest  c,  , in  column  j such 
j ij^ 

that  X,  . fi  S,  . If  a Xj  does  not  exist  for  some  j e J„,  set 
i]  k j F 


i*  = {i  X 


GUB 


1}  , and  go  to  13. 


7.  Solve  (C)  . If  v((C)  ) ^ go  to  3. 


LGR 


If  v(  (C)j^)  1 go  to  3. 


8.  Solve  (C)  and  get  a solution  x 

9.  Try  to  modify  x to  x so  that  x o ( U x.  .)  is  feasible 

in  (Pj^)  , and  such  that  the  corresponding  objective  value  is  equal 
to  v((C)j^).  If  successful,  go  to  12. 

10.  Select  a branch  variable  by  finding: 
t 


1*  j* 


= max 


(X . - c.  .)  • (b.  - h.  - 1 r X ) / r 

LOT  3 O 1 Ik  ^ 1] 

X.  . “1  £-3 

£*i 


If  there  is  a tie,  break  it  arbitrarily.  Add  the  problems 

(CP^Ix.  . ..  =0)  V h = k,...,K  and  (CP^Ix. . ..  = 1)  V h = k,...,K 
n 1*3*  n 1*3* 

to  the  candidate  list.  Update  J and  S V h = k,...,K.  Additional 

F n 

variables  may  be  pegged  to  0 for  individual  (Pj^)  as  in  steps  8a 

and  8b  of  Algorithm  E.  l^date  S,  V h = k,...,K  and  go  to  4. 

h 

11.  Set  V ( (C) , ) = v(  (B),  ) and  x^^  = x^^^. 

k k 

12.  An  improved  feasible  solution  to  (P  ) has  been  found.  Record 

this  solution  as  nhe  new  incumbent,  (x*)  = x^^  (U  x,  .), 

k _ 1 j 

and  set  z*  = v((C)  ).  If  k < K,  use  a feasibility  recovery 
technique  to  find  a feasible  solution  for  • If  this 

solution  improves  the  incumbent,  set  it  equal  to  and  its 

objective  value  to  Go  to  3. 

11'.  Add  the  problems  (CP,  lx..?  = 0)  V h = k+l,...,K  and  (CP,  lx..,?  = 1) 

n 3 h 1*3 
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i varicibles  may  be  assigned  to  0 for  individual  (P  ) as  in  step  11 

' ii'' 

V, 

\ of  Algorithm  E.  Update  V h = and  go  to  4. 

I h 


Basically  the  procedure  is  to  concentrate  on  (P^)  in  fathoming  tests 
and  brcinching  criteria  until  fathoming  for  (CP^^)  occurs  at  a given 
node.  Then  at  that  node  fathoming  tests  and  branching  criteria  are 
applied  to  the  corresponding  (CP^) . Note  that  if  (F^)  and  (P^)  are 
relatively  monotone,  and  if  v(CPj^)  > z*,  then  (CP^)  is  automatically 
fathomed.  Automatic  fathoming  also  occurs  if  no  feasible  solution 
to  a relaxation  Ccin  be  found.  In  step  13  pegged  to  1 for  (CPj^)  • 

However  the  peg  may  not  be  valid  for  (CPj^)  » = k.+l,..,,K  . Thus, 

(CPj^jx^^'  = 0)  and  = 1)  V h = k+l,...,K  are  added  to  the 

candidate  list.  It  is  clear,  however,  that  if  relative  monotonicity 

holds  between,  say,  (P,  ) and  (P^) , n > k,  then  (CP,  |x.*t  = 0)  need  not 

k h hi  1 j 

be  added  to  the  candidate  list. 

A third  approacn  for  4)  is  the  serial  method  where  each  problem  is 
solved  from  scratch.  This  approach  is  similar  _o  Algorithm  D in  chapter 
V.B,  and  it  may  be  dubbed  the  traditional  approach. 


■ 

,* 

■i 

k 

i 


[ 


i; 


Algorithm  H; 

1.  Set  k = 1. 

2.  Solve  (P  ) by  Algorithm  E getting  (x*),  . 

K 

3.  If  k > K,  stop.  If  (Pj^)  and  ^jre  relatively  monotone,  and 

if  e then  is  optimal  in 

k = k + 1,  and  return  to  the  beginning  of  this  step. 

4.  Set  k=k+l.  Ifk>K,  stop. 
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5.  Use  a feasibility  recovery  technique  on  9at  a good 

feasible  solution  for  (Pj.)  • Call  it  y.>  and  the  corresponding 
objective  value,  z*.  Go  to  2. 

Alternatively,  step  5 may  be  placed  in  step  10  of  Algorithm  E 

so  that  the  feasibility  recovery  technique  is  invoked  for 

whenever  a feasible  solution  for  (P  ) is  found.  This  option  is  used 

k 

in  our  computer  implementation. 

Comptitational  results  for  Algorithms  E,  G,  and  H are  given  in 
Table  H . Problems  were  generated  randomly  as  explained  in  section  A. 
The  first  right  hand  side  (for  (P^) ) was  generated  as  explained. 
Succeeding  right  heind  sides  were  obtained  by  reducing  all  resources 
by  fpproximately  2.5%  for  the  250  variable  problems  and  5%  for  the 

500  variable  problems.  Table  I gives  the  ratios  of  the  relative  times 

for  each  algorithm.  Note  that  Algorithm  F generally  dominates 

Algorithms  G emd  H,  except  for  the  50  variable  problems  where  Algorithm 

G was  best.  This  general  domination  by  Algorithm  F becomes  more 

pronounced  as  the  number  of  variables  increases.  This  behavior  is 

mainly  due  to  three  factors.  First  is  the  effect  of  bookkeeping  and 

setup  costs.  As  problem  size  increases,  computation  time  for  the 

primary  rela  ...ions  (LGR^)  and  (LGR^)  increase.^,  while  bookkeeping  and 

setup  costs  remain  about  the  same.  Second,  the  monotonioity  of  the 

feasible  regions  for  this  parameterization  allows  the  automatic 

fathoming  tests  to  be  used.  If  this  test  is  successful,  the  primary 

relaxations  need  not  be  solved.  Third,  tree  stability  tends  to  be 

GUB 

good  for  this  parameterization  due  to  the  stc±)ility  of  the  x and 
LGR 

X solutions  as  the  right  hand  side  varies. 
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c. 


Tlie  Generalized  Assignment  Problem  with  Finite  Number  of 
Objective  Functions 


In  this  section  we  consider  problem  5).  Basically/  Algorithms 
F,  G,  cind  H remain  the  same  with  three  exceptions.  Call  the  modified 
algorithms  F',  G',  and  H’.  First,  the  feasibility  recovery  technique 
is  modified  so  that  it  simply  costs  out  a feasible  solution  to  (R^) 
using  the  objective  function  for  • Second,  the  monotonicity 

test  is  no  longer  pertinent,  and  third,  the  automatic  fathoming  test  can 
no  longer  be  used.  However,  note  that  the  pegs  to  0 and  1 rem^nin 
Vdlil  for  V k • 1,...,K.  , since  these  pegs  are  based  only  on  feasibility 
considerations . 

We  remark  that  reduction  techniques  as  examined  in  Section  B do 
not  seem  to  be  promising  for  much  the  same  reasons.  In  addition 
bounding  problem  reoptimization  and  wide  range  bounding  techniques 
would  seem  to  be  inefficiei  t as  well,  due  to  many  of  the  reasons 
given  in  section  B. 

Analysis  of  the  tightness  of  the  primary  relaxation  in  section  B 

tends  t confir-n  that  the  tightness  is  a function  of  how  constraining 

the  agent  resources  are.  Since  in  5)  these  resources  remain  constant, 

GUB 

the  differences  in  tightness  would  seem  to  lie  in  the  initial  x 

solution  for  each  (R^) , k = 1,...,K  . If  a particular  x solution 

"almost"'  satisfies  the  knapsack  constraints,  then  one  might  surmise 

. , • ^ GUB 

that  the  initial  relaxation  is  tight.  Alternatively,  if  an  x 
solution  heavily  violates  the  knapsack  constraints,  then  the  relaxation 
will  be  loose.  Behavior  of  the  individual  integer  variables  in  an 
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optimal  solution  seems  to  i > as  obscure  as  for  4) . The  stability  of 

scratch  trees  seems  to  det .1.  orate  for  5)  as  opposed  to  the  stability 

for  4).  rt’e  propose  the  following  reasons  for  this  behavior.  Branch 

liGR 

variables  are  chosen  from  among  the  set  of  variables  for  which  - 1 . 

T JT  R TR 

Now  X. , =1  (in  (LGR-))  implies  that  x, . =1  (in  (LGR, ) ) . However, 

i]  2 1]  1 

GUB 

when  the  objective  function  is  varied  from  (R^^)  to  (R^)  , say,  x 

LGR 

generally  chwges  also.  This  in  turn  implies  that  x varies. 

LGR  “ 

Further,  x may  vary  due  to  the  values  which  are  generated  directly 
from  the  objective  function. 

We  now  present  a sufficient  condition  for  ein  optimal  solution  to 
remain  optimal  for  a certain  parameterization.  Suppose  an  optimal 
solution,  X*,  for  (A)  has  been  found.  Consider  the  problem  (A')  which 
for  some  teisk  j,  c J has  the  costs  c.'.  *c..  +d.  Viel  where 

1 1 

0 V i el  . Thus  the  cost  for  agent  i^^  to  perform  task  j^^  is 

Increased  by  d.  units.  Such  an  occurr'jnce  could  be  due  to  increased 
1 

processing  cost  for  task  • We  have  the  following  result. 


Theorem 


12 . Sv?)pose  X*  . =1.  If  v(A)  + d,  £v(a|x.  . 

^1^1  ^1  ^1^1 


= 0)  + min  cl . 


then  X*  is  optimal  in  (A'). 


Projf ; Since  Z x.  , = 1 in  einy  optimal  solution,  and  since 


v(A  X. 


iel  "^1 

0)  2.v(A),  any  optimal  solution  to  (A'|x,  . =0)  must 


have  a cost  of  at  least  v(A  x.  . = 0)  + min  d.  . But  x*  remains 

11  i^ij^ 

feasible  in  (A')  with  a cost  of  v(A)  + d^  . Hence  if  the  hypothesis 
holds,  X*  is  optimal  in  (A').  I I 


Note  that  any  underestimate  of  v(a|x,  , =0),  such  as  the  value 

^1^1 

v(A),  may  be  used  in  the  theorem  hypothesis. 


Two  problem  sets  were  generated  per  Ross  and  Soland  [1974]  . For 
the  first  set,  additional  objective  functions  for  each  problem  were 
generated  randomly  using  the  original  objective  function.  One  third 
of  the  cost  coefficients  were  varied  by  ±10%,  one  third  by  ±5%,  and 
one  third  remained  the  same.  Table  j gives  individual  problem  results 
(11-18) , and  Table  K gives  ratios  of  computation  times  for  the 
algorithms.  We  see  that  generally  Algorithm  H'  performs  the  best, 
with  Algorithms  F*  and  G'  sometimes  requiring  more  than  twice  as  much 
computation  time.  This  was  found  to  be  attributable  to  tree  instability. 
That  is,  the  individual  scratch  trees  were  not  st£d)le  from  or.e  problem 
to  the  next.  This  points  out  the  importance  of  scratch  tree  stability 
in  formulating  parametric  branch  ^uld  bound  algorithms.  Basically  the 
evidence  gleaned  from  these  test  problems  is  that  the  set  of  fathomed 
nodes  from  (Pj^)  is  not  a "good"  initial  sepeuration  for  • We 

conclude  that  Algorithm  H'  would  seem  to  be  prefered^le  for  this 
particular  parameterization. 

In  the  second  problem  set,  an  additional  objective  function  was 
generated  by  increasing  all  costs  for  one  agent  by  iO%.  Tcible  J gives 
individual  problem  results  (19-23) , and  Table  K gives  ratios  of 
computation  times.  For  this  set  of  problems.  Algorithm  G'  dominates 
Algorithms  F'  and  H'.  This  contrasts  with  problems  (11-18)  where 
Algorithm  H'  generally  was  best.  The  reason  for  the  difference  is 
greater  tree  stability  which  is  a result  of  the  less  "radical" 
parameterization  in  problems  (19-23) . Since  costs  are  raised  by  10% 
for  only  one  agent,  the  and  solutions  tend  to  remain  stable 

at  a given  node,  and  hence  tree  stability  is  more  pronounced. 


In  conclusion,  Algorithm  H*  seems  to  be  best  for  more  "radical" 
parameterizations , while  Algorithm  G*  tends  to  be  best  for  "minor" 
paramcterizations . 


D.  The  Generalized  Assignment  Problem  with  a Continuous  Objective 


Function  Parameterization 


In  this  section  we  consider  problem  6)  . Our  goal  is  to  find 
optimal  solutions  for  all  possible  weightings  of  two  different  objective 
functions. 

Due  to  the  relatively  poor  results  for  Algorithm  F'  :.n  section  C 
we  did  not  code  an  approach  using  the  serial  method  with  an  advanced 
initial  separation.  Ar.  algorithm  corresponding  to  G'  was  not  developed 
because  of  the  inherent  difficulty  involved  in  choosing  values  of  0 at 
which  to  solve  a relaxation  at  a given  node.  Only  the  approach 
corresponding  to  Algorithm  K'  was  coded.  Algorithm  H"  is  similar  to 
Algorithm  D"  in  chapter  V. D with  the  exception  of  using  Algorithm  E 
instead  of  Algorithm  A in  step  2 and  replacing  LB(0)  by  UB(0).  The 
reader  is  referred  to  chapter  V.D  for  an  explanation  of  the  reasoning 
behind  this  approach. 

Test  problems  were  generated  per  Ross  and  Soland  [1974]  in 
precisely  the  same  manner  as  given  in  section  A.  The  f^^  coefficients 
were  generated  randomly  from  a U[10,50]  distribution  which  had  a 50% 


correlation  coefficient  with  the  corresponding  c^^. 

Computational  results  are  shown  in  Teible  L.  Note  that  just  as 

with  the  0-1  knapsack  results  of  chapter  V.D,  the  number  of  problems ,( Q. ) , 

0 

solved  is  slightly  less  than  twice  the  number  of  optimal  solutions 


found  over  V 0 c [0.]).  This  It  further  substantiation  of  the 
effectiveness  of  the  method  for  solving  the  continuum  of  problems 
(Q^j)  V 0 e [0,11. 
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Table  H 


Comparison  of  Algorithms  F,  G,  H for  the  Generalized  Assignment  Problem 
with  5 Right  Hand  Sides:  Monotone  Feasible  Regions 
(Time  in  seconds  excluding  I/O  on  an  IBM  360/91) 


Algorithm  F 

Algorithm  G^ 

Algorithm  H 

(Traditional) 

Number 

Agent 

of  Total 

of  Total 

of  Total 

Problem  Resources 

Nodes  Time 

Nodes  Time 

Nodes  Time 

A.  50  varieible  problem  from 

Ross  cind  Soland 

[1974] 

1.  88 

5 

.009 

5 

.008 

80 

2 

.011 

5 

.010 

7_ 

41 

.077 

29 

.044 

o4 

7 

.017 

27 

.042 

19 

.031 

29 

.045 

Setup 

.011 

.007 

Totals 

TA 

.156 

78 

.110 

9? 

.156 

B.  Randomly  generated  250 

variable 

problems  with  5 

agents 

and  50  tasks 

2.  185 

3 

.018 

3 

.015 

180 

0* 

0 

0* 

0 

175 

55 

.189 

57 

.200 

170 

0* 

0 

0* 

0 

165 

45 

.141 

51 

.175 

Setup 

.023 

.023 

Totals 

loJ 

.371 

146 

.387 

iiT 

.413 

3.  185 

21 

.064 

21 

.065 

180 

0* 

0 

0* 

0 

176 

3 

.009 

41 

.155 

172 

60 

.240 

45 

.160 

167 

0* 

0 

0* 

0 

Setup 

.022 

.023 

Totals 

'kA 

.335 

228 

.527 

107 

.403 

4.  179 

1 

.007 

1 

.004 

174 

25 

.070 

25 

.073 

170 

0* 

0 

0* 

0 

1G5 

0* 

0 

1 

.006 

160 

0* 

0 

1 

.006 

Setup 

.021 

.019 

Totals 

26 

.099 

65 

.135 

~2e 

.108 

f Due  to  the  nature 

of  the 

lexicographic 

serial 

approach , 

computation 

times  for  individual  problems  cannot  be  broken  out. 

* Optimal  solution  from  previous  problem  is  feasible,  hence  optimal. 

# Feasibility  generator  time  plus  setup  time. 
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Table  H (contlnuiid) 


Algorithm  F Algorithm  G Algorithm  H 


Agent 

Problem  Reiiources 

Nimber 

of 

Nodes 

Total 

Time 

Number 

of  Total 

Nodes  Time 

Number 

of 

Nodes 

Total 

Time 

5.  195 

1 

.007 

1 

.005 

189 

1 

.006 

1 

.005 

185 

1 

.007 

1 

.007 

161 

55 

.224 

55 

.210 

176 

38 

.128 

43 

.168 

Setup 

.021 

.020 

Totals 

96 

.403 

83 

.304 

loT 

.415 

6.  3.75 

41 

.107 

41 

.109 

170 

0* 

0 

0* 

0 

166 

31 

.101 

43 

.111 

161 

35 

.103 

57 

.160 

157 

221 

.787 

253 

.920 

Setup 

.030 

.032 

Totals 

3^ 

1.128 

459 

1.391 

394 

1.332 

C. 

Randomly  generated  500  varijdjle 

problems  with  10 

agents 

and  50  tasks 

7. 

102 

1 

.009 

1 

.006 

97 

1 

.007 

1 

.006 

92 

1 

.011 

1 

.006 

87 

21 

.104 

21 

.080 

82 

25 

.080 

75 

.270 

Setup 

.042 

.042 

Totals 

49 

.252  100 

.365 

99 

.410 

8. 

107 

1 

.008 

1 

.006 

102 

1 

.007 

1 

.006 

97 

33 

.146 

33 

.125 

92 

16 

.078 

51 

.206 

87 

39 

.242 

63 

.387 

Setup 

.047 

.047 

Tot^ds 

90 

.528  129 

.586 

149 

.111 

9. 

95 

11 

.031 

11 

.028 

90 

0* 

0 

0* 

0 

85 

1 

.008 

11 

.028 

60 

23 

.067 

33 

.080 

75 

1 

.005 

17 

.060 

Setup 

.045 

.044 

Totals 

36 

.156  78 

.221 

12 

.240 
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Agent 

rroblem  he  sources 


Table  H (continued) 
Algorithm  F Algorithm  G 


Number 

of  Total 

Nodes  Time 


112 

1 

.007 

107 

17 

.057 

102 

5 

.021 

97 

35 

.142 

92 

8 

.026 

Setup 

.040 

Total  5 

66 

.292 

Number 

of  Total 

Nodes  Time 


Algoirithm  H 
Nrmber 

of  Total 

Nodes  Time 


Table  I 

Ratios  of  Computation  Times  for  Algorithms  F,  G,  H with  H Scaled  to  1. 


Problem 

1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 


Number 

of 

Variables 


Algorithm  F 
(Serial) 
1.00 


Algorithm  G 
(Lex. Serial) 
.67 


Algorithm  H 
(Traditional) 

1. 
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Comparison  jf  Al<,r'rithms  I",  G',  H'  for  the  Generalized  Assignment 
Problem  with  a Finite  Number  of  Right  Hemd  Sides 
(Time  in  seconds  excluding  I/O  on  eui  IBM  360/91) 


Algorithm  F*  Algorithm  G'^  Algorithm  H' 

(serial)  (Lex. Serial)  (Traditional) 


Objective 

Function 

Number 

of 

Total 

Number 

of 

Total 

Number 

of 

Total 

Problem  Identifier 

Nodes 

T-lmo 

Nodes 

Time 

Nodes 

Time 

A.  Randomly  generated  250  variable 


problems  with  5 

agents  euid  50  tasks  with  K = 5 

11.  a 

1 .008 

1 

.007 

b 

1 .012 

1 

.007 

c 

1 .012 

1 

.007 

d 

1 .015 

1 

.007 

e ^ 

1 .015 

1 

.007 

Setup 

_ .022 

.018 

Totals 

5 .084 

5 .056 

5 

.056 

12.  a 

43  .115 

43 

.080 

b 

22  .068 

1 

.007 

c 

22  .05t 

1 

.007 

d 

22  .C52 

1 

.007 

e 

42  .09-'' 

21 

.040 

Setup 

.030 

.028 

Totals 

151  .416 

178  .384 

.169 

13.  a 

455  1.630 

455 

1.192 

b 

377  1.372 

377 

.905 

c 

881  3.056 

665 

1.600 

d 

439  1.376 

213 

.511 

e 

754  2.888 

105 

.252 

Setup 

.030 

.030 

Totals 

2906  10.322 

2245  5.388 

1815 

4.390 

14.  a 

1 .009 

1 

.007 

b 

1 .015 

1 

.007 

c 

1 .012 

1 

.007 

d 

1 .015 

1 

.008 

e 

1 .011 

1 

.007 

Setup 

.022 

.023 

Totals 

5 .084 

5 .056 

5 

.059 

+ Due  to  the  nature  of  the  lexicographic  serial  approach,  computation 
times  for  individual  problems  cannot  be  broken  out. 

# Feasibility  generator  time  plus  setup  time. 
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Table  J (continued) 


Algorithm  F* 


Algorithm  G' 


Algorithm  H' 


Objective 

Number 

Number 

Number 

Function 

of 

Total 

of 

Total 

of 

Total 

Problem  Identifier 

Nodes 

Time 

Nodes 

Time 

Nodes 

Time 

B.  Randomly  generated  500  variable 

problems  with  10 

agents  and  50  tasks 

; w th  K 

- 5 

15.  a 

51 

.181 

51 

.112 

b 

156 

.583 

71 

.156 

c 

162 

.517 

49 

.108 

d 

94 

.260 

23 

.051 

e 

60 

.179 

25 

,550 

Setup 

.040 

.129 

Totals 

52? 

1.760 

512 

1.251 

219 

1.106 

16.  a 

49 

.192 

49 

.162 

b 

25 

.111 

1 

.006 

c 

139 

.617 

69 

.228 

d 

238 

1.202 

143 

.472 

e 

60 

.230 

1 

.006 

Setup 

.050 

.124 

Toted  s 

sir 

2.402 

313 

1.160 

2^ 

.998 

37.  a 

211 

.802 

211 

.780 

b 

708 

2.847 

301 

1.130 

c 

388 

1.836 

355 

1.311 

d 

222 

.915 

363 

1.342 

e 

839 

4.103 

599 

2.224 

Setup 

.098 

.124 

Totals 

2365 

10.601 

1589 

. 032 

1829 

6.911 

18.  a 

89 

.453 

89 

.312 

b 

59 

.236 

41 

.144 

c 

52 

.215 

35 

.123 

d 

842 

4.003 

370 

1.330 

e 

110 

.653 

79 

.277 

Setup 

.102 

.112 

Totals 

1152 

5.662 

1781 

6.228 

623 

2.308 

i 
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Table  t j (continued) 


! 

I 

I 


Algorithm  F* 

Algorithm  o' 

Algorithm  H' 

Objective 

Number 

Number 

Number 

Function 

of 

Total 

of 

Total 

of 

Total 

Problem  Identifier 

Nodes 

Time 

Nodes 

Time 

Nodes 

Time 

C.  Randomly  generated  250 

variable 

problems  with  5 

agents 

and 

50  tasks 

with  K 

2 

19.  a 

19 

.075 

19 

.069 

b 

10 

.051 

19 

.082 

Setup 

.011 

.007 

Totals 

29 

.137 

29 

.093 

38 

.158 

20 , a 

63 

.219 

63 

.220 

b 

104 

.453 

85 

.340 

Setup 

.011 

.012 

Totals 

‘.683 

117 

.317 

148 

.572 

21.  a 

73 

.312 

73 

.315 

b 

59 

.299 

87 

.374 

Setup 

.015 

.o:.5 

Totals 

132 

.626 

118 

.369 

160 

.704 

22.  a 

35 

.168 

?5 

.163 

b 

114 

.502 

139 

.629 

Setup 

.012 

.013 

Totals 

149 

.682 

155 

.591 

174 

.805 

23.  a 

39 

.173 

39 

.J68 

b 

24 

.109 

43 

.194 

Setup 

.012 

.011 

Totals 

eT 

.294 

63 

.214 

eJ 

.373 
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Table  K 

Ratios  of  Computation  Times  for  Algorithms  F',G',H’  with  H'  Scaled  to  1. 


Problem 

Number 

of 

Variables 

Algorithm  F' 

Algorithm  G' 

Algorithm  H ' 

11. 

250 

(Serial) 

1.50 

(Lex. Serial) 
1.00 

(Traditional) 

1. 

12. 

250 

2.46 

2.27 

1. 

13. 

250 

2.35 

1.23 

1. 

14. 

250 

1.44 

.95 

1. 

15. 

500 

1.60 

1.13 

1. 

16. 

500 

2.41 

1.16 

1. 

17. 

500 

1.53 

.87 

1. 

18. 

500 

2.45 

2.70 

1. 

19. 

250 

.87 

.59 

1. 

o 

CM 

250 

1.19 

.55 

1. 

21. 

250 

.89 

.52 

1. 

22. 

250 

.85 

.73 

1. 

23. 

250 

.79 

.57 

1. 
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Algorithm  H"  for  the  Generalized  Assignment  Problem  with  a Continuous  Objective  Function 

(Time  in  seconds  excluding  I/O  on  an  IBM  360/91) 
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VII.  THE  PARAMETRIC  CAPACITATED  FACILITY  LOCATION  PROBLEM 


Consider  tJie  problem: 

min  E E c x,  . + E f .y 

0 iel  jeJ  lel  ^ 


y^-0,1 


Vi 

DeJ 


E X, . * D. 
iel  ' 


V i t I 


V j E J 


where  c.  , > 0,  f.  > 0,  S.  > 0,  and  D.  > 0.  This  problem  is  often 

13-1-1  3 

referred  to  as  the  capacitated  facility  location  problem.  The  index 
set  I denotes  a collection  of  potential  facilities  (or  plants  or  ware- 
houses), and  J denotes  a collection  of  customers  which  are  to  be  serviced 
by  the  facilities.  The  maximum  throughput  for  facility  i is  S^,  and 
is  the  demand  attributable  to  customer  j . The  cost,  c^^,  is  the 
transportation  cost  for  supplying  one  unit  of  demand  to  customer  j from 
facility  i.  The  fixed  cost,  f^,  is  the  cost  of  opening  facil-^ty  i . 

A great  deal  of  research  has  been  devoted  to  this  particular 
problem  class.  An  exhaustive  survey  on  the  subject  is  given  in  El-Shafei 
and  Haley  (1974).  Geoffrxon  [1974b]  presents  an  up-to-date  catalog  of 
current  solution  methodologies  and  computer  codes  available  for  solving 
various  formulations  of  the  facility  location  problem.  Quite  recently 
Akinc  and  Khumawala  (AK)  [1974]  devised  an  efficient  branch  and  bound 
algorithm  which  has  dramatically  reduced  computation  times  for  (P)  over 
existing  algorithms. 

In  section  A we  shall  present  a branch  and  bound  algorithm  for  (P) 


which  is  comparable  in  computation  time  to  AK's  algorithm  for  moit  test 
problems,  and  improves  upon  their  results  for  other  test  problems.  In 
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section  D we  shall  present  an  approach  for  solving  the  general  parametric 


capacitated  facility  location  problem: 
7)  For  k = 1,...,K  solve: 


0 iel  jeJ  id  ^ ^ 


y.-0,l 


-i:  ^ * V'-i  - = ' 


V j e J 


Z X. . - (D.  + E ) 
id  ^ 


where  d.  ,,  , g.,  # T,,  , and  E,,  are  scalars. 
13k  ik  ik  3k 


A.  An  Algorithm  for  the  Capacitated  Facility  Location  Problem 


Consider  problem  (P) . W<j  shall  begin  the  emalysis  of  this  problem 

by  presenting  basic,  well-known  results,  and  then  some  new  results  will 

be  proved.  After  this,  an  efficient  algoritluu  will  be  stated,  and 

computational  results  will  be  cited. 

SA  [1969]  observed  that  in  the  continuous  relaxation 

of  (P) , namely  (P)  , where  0 £ y^  ^1  replaces  y^  = 0,1  , it  is  possible 

to  substitute  the  y^  variables  out  of  the  problem.  That  is,  let 

y.  = Z X,  . / S.  . This  may  be  done  since  for  any  optimal  solution 

^ _ jeJ  ^ _ _ 

(x,y)  to  (P)  , we  necessarily  must  have  Z x..=S.y.  Vicl.  The 

. ^ 13  11 

leJ 

substitution  is  carried  out  by  replacing  the  supply  constraints  by 

Z X. .<S.  Vicl,  and  the  objective  function  by 
. _ 13  — 1 

3eJ 

min  Z Z (c . . + f . /S , )x . . . It  is  easy  to  see  that  the  resulting 

x..>  0 id  jcJ  ^3  1 I X3 

13- 

problem  is  a transportation  problem.  Hence,  (P)  may  be  solved  using  a 
transportation  or  network  algorithm  rather  than  a linear  progreimming 
algorithm.  This  allows  for  significant  savings  in  computation  time. 
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r:,  i I-  ■•' 


Ellwein  [1970]  gives  the  following  result.  Let  (P  ) ■ (P|y.  ■ 1 

A 1 


V i e I) . 


Theorem  13.  If  v(P. |y.  - 0)  - v(P.)  > 0 , then  the  optimal  solution 

_ ■ A 1 A ~ 

o 

value  for  (P)  is  not  affected  by  setting  y^  = 1 . 

o 

Basically  this  result  states  that  If  the  added  trwsportatlon  cost 


Incurred  by  closing  facility  1^  Is  greater  than  or  equal  to  the  fixed 

cost  of  opening  facility  1 . then  facility  1 may  be  fixed  open  In  an 

o o 

optimal  solution  to  (P) . 

AK  {1974]  give  the  following  result.  Let  T.  ^ {j|c^  • ■ niln 

^o  ^o^  1 ^ 

and  for  V j e T let  X,  ■ min  c. . . The  index  set  T Is  that  set  of 

^o  J 1^1  o 

o 

customers  j for  which  facility  1^  supplies  the  demand  for  the  least 
cost.  The  value  X . , j e is  the  second  smallest  transporation  cost 
for  customer  j. 


Theorem  14.  If  meuc  Z (X,  - c.  ,)x.  . ^ f . t then  the 

0 <x,  D.  jeT.  J o 

-y-  1 

optimal  solution  value  for  (P)  is  not  affected  by  setting  y^  «»  1 . 

o 

The  knapsack  problem  In  the  theorem  statement  gives  a measure  of 

the  tremsporation  cost  savings  which  can  be  realized  If  facility  1^  Is 

opened.  If  this  saving  is  larger  than  the  fixed  cost  f,  , then  the 

o 

facility  may  be  pegged  open. 

AK  show  that  Theorem  13  dominates  Theorem  14.  Specifically,  if  y. 
can  be  pegged  to  1 via  Theorem  14,  then  it  can  always  be  pegged  to  1 
via  Theorem  13,  but  not  vice  versa.  Both  theorems  allow  one  to  peg 


facilities  open  if  a particular  test  is  passed.  For  the  Ellwein  test  a 


transportation  problem  is  solved  for  facility  1.  The  (AK)  test  on  the 
other  hand  only  requires  a continuous  knapsack  to  be  solved  for  each 
facility  i.  Conputationally  then,  the  (AK)  test  is  more  attractive 
even  though  it  is  a we2dcer  test. 

We  now  present  a result  which  tightens  the  constraint  structure  of 


(P) . Let 


Q • ” { 3 Cj  • ■ will  c,  . and  c.  . ft  min  c . . } , and 

1 ' i D , il  i 3 13 

o o i ■'  o-'  ifti  ■’ 


L.  = min  { Z D.  , S,  }.  If  Q.  ■ 0,  then  define  Z D,  to  be  zero, 
i i i i 

o jeQ^  ■’  o o 

o o 

The  index  set  Q.  denotes  those  customers  j for  which  facility  i has 

the  unique  smallest  transportation  cost  over  all  facilities.  Let 

{x*,y*)  be  an  optimal  solution  for  (P) . 


Theorem  15.  It  the  constraint  Z x.  . £ S.  y,  is  replaced  by 

jeJ  ^o^  ^o  ^o 

^i  ^i  — ^ *i  ' — ^i  ^i  ' optimal  solution  to  (P)  will  ..ot  be 

^o  ^o  jcJ  ^o^  ^o  ^o 
affected. 


Proof ; If  y*  =0  the  two  constraints  are  equivalent.  For  y*  = 1 there 
o o 

are  two  cases:  a)  Z x*  . = S.  and  b)  Z x*  . < S.  . If  a)  holds, 

jrJ  o o 3eJ  o o 

the  two  constraints  ..'.re  equivalent.  Only  case  b)  remains.  We  will 

show  that  Z X*  . > L.  , We  assume  Z . < L.  . Recall  that 

3eJ  o o jeJ  o o 

L.  = min  { Z D,  , S.  }.  For  some  i e Q.  we  must  have  x^  . < D,  , 

1 11  o 1 111 

o jcQ^  •'  o o o-'o  -"o 

since  otherwise  we  would  have  Z x*  . = Z D.  ^ L.  _ So  for 

jeQ^  ^o^  jeQ^  ^ 

o ^o 

X*  . < D.  3 an  i,  such  that  x*  . >0.  Now  by  transferring  one  unit 

1 3 3 1 1,3 

o o o 1 o 

of  flow  from  x*  . to  x*  , , we  clearly  remain  feasible,  but  since 

1, 3 13 

1 o o o 

j G Q.  we  have  c.  . < c.  . , and  so  the  modified  solution  is  not  only 
o 1 1 3 1,3 

o o o 1 o 

feasible,  but  it  edso  has  a smaller  objective  function  value. 


Contradiction. 
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Thiu  result  allowii  tis  to  put  a lower  bound  on  the  throughput  of 


any  facility  in  an  optimal  solution  to  (P) . By  adding  this  lower  bound 
on  throughput,  we  theoretically  tighten  the  primary  relaxation  (P)  . 

However  since  j;  x.  .»S.y.  Viel»  and  since  L.  < S,  V i e If  we 

jeJ  ‘ ‘ ‘ ‘ 

sea  that  this  added  restriction  on  throughput  has  no  effect  on  (P) . 

Nonetheless,  it  c^m  be  used  to  advwtage  for  other  releucations  which 

are  tighter  them  (P) . 

Another  result  allows  precedence  relations  of  the  form  y^  ^ y^^  to 
be  added  to  (P)  . Such  a constraint  Implies  that:  a)  if  y^  =*  0,  then 


y^  - 0 , or  b)  if  y^  = 1/  then  yj^  = 1 


Let 


^ {j 


c,  , = min  c. . } and 
Ij  i3 


for  each  j e V, , let  A . * min  c.  . . Define  x,  . to  be  em  optimal 
1 J 1^1,2  iJ  IJ 


solution  to  v(E)  - meuc 


I »«  {0  , c - c ).X 

0 <x, .<  D.  leJ 
-■  lO-  3 

jeJ 


Further,  define  v(L)  « max 


0 <x, .<  D.  jeV, 
- I3-  3 ■’  1 


(Xj  - =2.)X2. 


E X < S - E X,  . 


The  value  v(E)  is  the  m.aximum  added  tremsportation  cost  incurred  if 
facility  1 is  used  in  place  of  facility  2 in  any  facility  design.  The 
value  v(L)  is  similar  in  meaning  to  the  term  in  Theorem  14.  It  is  a 
measure  of  the  savings  in  transportation  cost  if  facility  1 is  opened, 
and  facility  2 is  closed.  Let  (x*,y*)  be  an  optimal  solution  for  (P)  . 


Theorem  16.  if  ^ and  f^  + v(E)  - v(L)  < f^,  then  y*  < yj  in  any 
optimal  solution  to  (P)  . Henct  the  constraint  y^  ^ y^^  may  be  added 
to  (P)  . 
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V 


Proof ; Assume  not.  Then  y*  “ 0 and  y*  ■ 1 in  am  optimal  solution  to 

(P) . We  will  show  that  v(p|yj^  ■ 1»  yj  “ 0)  < vCPjy^^  ■ 0,  y^  ■ 1)  in 

order  to  gain  a contradiction.  Suppose  that  we  have  am  optimal  solution, 

(x*,y*)  , for  (pjy^^  = 0,  y^  = 1)  What  changes  occur  in  the  optimal 

solution  value  if  we  now  set  1 y2  “ ® ^ Since  ^ we  may 

let  *>  x*j  and  x^^  = 0 V j c i.  This  merely  reassigns  all  flow 

emanating  from  facility  2 to  emanate  now  from  facility  1.  All  other 

components  of  (x,y)  will  be  set  equal  to  tl.e  corresponding  values  in 

(x*,y*).  Clearly  this  modified  solution  is  feasible.  Now  v(E)  is  the 

maximum  additional  transportation  cost  incurred  by  the  switch  of 

facilities.  Note  that  is  used  in  the  knapsack  constraint  for  v(E)  , 

since  is  the  maximum  eunount  of  throughput  which  cam  be  handled  by 

facility  2 in  any  feasible  solution.  The  value  v(L)  is  the  minimum 

amount  of  transportation  cost  which  can  be  saved  by  opening  facility  1. 

Note  that  (S  - I x^.)  is  used  in  the  knapsack  constraint  for  v(L) , 

since  it  is  the  maixiri'un  amount  of  throughput  for  which  transportation 

savings  can  be  assured.  Observe  that  the  v(L)  calculation  is  closely 

related  to  the  calculation  in  Theorem  14  with  the  additional  stipulation 

on  and  which  excludes  i ■ 2 from  consideration  since  y^  = 0 in 

(p|y^  = 1,  y^  = 0)  . By  combining  the  relevant  terms,  we  have 
? 

f^  + v(E)  - v(L)  < f^.  If  inequality  holds,  then  a feasible  solution 
exists  with  objective  value  less  them  v(p|yj^  =0,  y^  “ 1)  . 

Contradiction.  I I 


\ 


i 


.( 
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observe  that  this  result  requires  the  calculation  of  only  two 
continuous  knapsacks  for  each  pair  of  facilities.  Thus  the  computational 
burden  is  liqht.  We  note,  however,  that  if  a constraint  £ y^^  were 
added  to  (P),  the  transportation  structure  of  the  problem  would  be 
destroyed.  Nonetheless,  these  types  of  constraints  may  be  added  to 
other  relaxations,  emd  may  also  be  used  in  conditioral  pegging  emd 
penalty  tests. 

We  shall  now  give  a relaxation  which  is  at  leart  as  strong  as  (P) 
in  objective  value,  and  which  generally  yields  stronger  penalties. 
Consider  the  following  Lagrangecin  relcucation  where  the  demeuid  constraints 
are  placed  in  the  objective  function: 

min  E E c. .x. . + E f.y.  + E X,(D.  - Ex,.) 

X.  .>  0 iel  jeJ  iel  ^ ^ jej  ^ ^ iel 

1]- 

Ex  <Sy  Vie  I, 

. _ ij  - i'i 


or  equivalently 


E X.D. 
jeJ  ^ ^ 


(LGR^) 


max  E E (X.  -c..)x.. 

x. ,>  0 id  jeJ  ' 
iD- 

y. =0,l 

E X. . < S,y. 

, , 11  “ 11 
3 eJ 


f.y. 

• T 11 

lEl 


V i c I 


This  is  a valid  relaxation  and  it  is  easily  seen  that  v(P)  ^ v(LGF(^) 
v(P)  if  optimal  dual  multipliers,  X,  from  (P)  are  used.  We  mention 
that  if  a transportation  algorithm  is  used  to  solve  (P)  (the  Y^'s 
having  been  substituted  out  of  the  problem)  , then  the  dual  multipliers 
for  the  LP  formulation  of  (P)  must  be  recovered  from  the  optimal  dual 
multipliers  of  the  transportation  formulation.  The  recovery  is  not 
difficult  to  accomplish,  consisting  only  of  elementary  trcinsformations 
for  a number  of  special  cases.  These  tr^msfo^nations  yield  X. 
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Unfortunately  it  is  often  the  case  that  v(LGR^)  - v(P).  Thus,  here 
the  Lagrat.qe^kn  releucatlon  Is  no  stronger  th£m  the  continuous  relaxation. 
However,  t!»ere  are  at  le2ist  three  different  calculations  which  generally 
tighten  the  releixation  measurably. 

The  first  is  a simple  improvement  in  the  Specifically,  set 

X.  ■ nwuc  {X.  , c,  .}  V j e J where  c.  . is  the  second  smallest 
transportation  cost  for  customer  j over  all  available  facilities. 

This  adjustment  is  intuitively  appealing  since  one  would  envision  the 
cost  of  increasing  a customer's  demand  by  one  unit  to  be  the  transport- 
ation cost  from  the  second  cheapest  facility  which  serves  customer  j. 

It  is  this  economic  interpretation  which  leads  to  the  definition  of 

A A 

Xj  . Empirically,  this  choice  of  x has  been  effective  in  tightening 
the  Lagrangecin  relaxation. 

The  second  improvement  is  the  addition  of  the  constraints; 

L.y.  < I X,,  Viel  to  (LGR^)  where  L,  is  the  lower  bound  on 

11  - . _ 1]  1 1 
leJ 

throughput  for  facility  i as  given  in  Theorem  15. 

The  third  improvement  is  to  append  the  constraint: 

Z S.y.  ^ Z D.  to  (LGrS  . This  constraint  forces  feasibility 

id  ^ ^ jEJ  ^ ^ 

of  any  facility  design  by  requiring  that  sufficient  facilities  are 
opened  to  handle  the  total  demand.  Of  course  the  customer  demand 
constraints  may  still  be  violated  in  (LGR^)  since  they  have  been  relaxed. 
By  combining  all  three  improvements,  we  have  the  following 


tighter  releixation: 


i 


I 


I X.D. 
^ => 


- max  Z Z {\.  - c )x  - z f.y. 

0 Dj  iel  jcJ  ^ ^ ^ id 


y^-0,1 


(lgr;^ 


- UJ  ' 


Z s y > Z D 
id  jeJ 


While  this  rel£Ucation  may  appear  to  be  difficult  to  solve  efficiently, 
we  shall  show  that  it  is  not.  By  projecting  on  the  space  of  y variables, 
we  see  that  the  optimization  over  the  x varieUsles  ceui  be  carried  out 

A A A 

independently.  Clearly  if  y^^  * 0,  then  x.  .=*0  VjeJ. 

then  X,  . = X.  . V j e J where  x,  . is  em  optimal  solution  to: 
ijij"*  11  ^ 

o o o-' 

. (i  ,X)  = max  -f.  + Z (X.  - c.  .)x.  . 

° 0 <X.  .<  D.  "o  ^ V *0^ 

— 1 J~  1 
0-'  ■' 

L.  < z y.  . < s, 

1 , iD“  i 

o jeJ  o o 

A 

Hence,  for  each  i e I a continuous  knapsack  is  solved  to  obtain  v(i,X). 
Then  the  following  problem  is  solved  over  y: 


max 


y^=0,l  iel 


Z v{i,X)y, 


(F) 


Z S.y.  > Z D, 

T 1 1 ~ • T 3 

lel  leJ 


Problcr.i  (F)  is  a 0-1  knapsack  pniblem  in  y which  may  be  solved  very 
efficiently  by  the  methods  of  chapter  V.  Let  y denote  an  optimal 
solution  of  (F)  . We  note  that  generally  the  knapsack  has  fewer  than 
I l|  free  variables,  since  if  v(i,X)  ^ 0 we  may  set  y^  * 1 in  any  optimal 
solution  to  (F)  . Thus,  in  orde^  to  solve  (LGR^)  we  first  solve  a 
continuous  knapsack  in  x . for  each  facility  i . Then  we  use  the 
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solution  values  for  these  knapsacks  to  solve  a 0-1  knapsack  in  y. 

Note  that  penalties  may  be  easily  calculated  for  the  y variables. 
For  exeunple,  suppose  y^  ■ 1 in  (F)  . A penalty  for  y^  * 0 may  be  found 
by  solving  (Pjy^  * 0)  or  (pjy^  « 0)  where  (F)  is  the  continuous  relax- 
ation of  (F) . Thus  (F)  is  a continuous  knapsack.  Clearly,  at  a given 
node  in  a branch  and  bound  tree  if  v(F|y^  ■ 0)  ^ z*, where  z*  is  the 
cu’-rent  incumbent  value,  we  may  set  y^  ■ 1 in  all  successors  of  that 
node.  Further,  these  continuous  knapsack  solutions  may  be  used  in 

choosing  the  next  branch  variable  at  a node.  Specifically,  one  may 

A , 

order  the  y^  variables  in  decreasing  order  of  = max  (0  , 

|v(F|y^  * 1 “ “ v(F|y^  = y^)  |}  . The  bremch  variable  is  chosen 

CO  be  i » {ilmax  P.  } . If  a LIFO  priority  scheme  is  used,  then  one 

° i ^ , 

would  place  (CP|y.  * 1 - y.  ) emd  (CP I y,  » y.  ) in  the  candidate 
i 1 1 1 

o o ^ o o 

list  in  that  order.  Thus  the  y.  = y.  branch  would  be  examined  first. 

1 1 
o o 

We  shall  now  state  an  efficient  algorithm  for  (P) . Let  be 

the  index  set  for  y.  set  to  0(1).  Let  K_  = I - K.  • K . 

1 2 0 1 

Algorithm  1; 

1.  Set  Kq  = = 0,  = I,  and  let  z*  be  a large  number. 

2.  For  V i c K,  perform  the  pegging  test  of  Theorem  14.  If 

successful,  set  1 U {i} 

3.  For  V i e perform  the  pegging  test  of  Theorem  13.  If 

successful,  set  y^  = 1 and  set  U {i}. 

4.  Initialize  the  candidate  list  to  consist  of  (p|y.  = 1 V i e K,  ) . 
Call  this  problem  (CP)  , and  go  to  9. 

5.  Stop  if  the  candidate  list  is  empty;  if  there  exists  an  incumbent, 
then  it  must  be  optimal  in  (P) , otherwise  (P)  has  no  feasible 
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solut ion. 

Select  a proolem  (CP)  from  the  ceuididate  list  using  a L1?0  rule. 
Reset  Kq,  to  coincide  with  the  restrictions  of  (CP).  If  END  (CP) 
exists,  £Uid  if  END  (CP)  ^ z* , go  to  5. 

For  V i e perform  tlie  pegging  test  of  Theorem  14.  If  successful, 


set  y.  “ 1 and  set  K = K U {i}. 

’ 11 

z s < z .. 
feKiUK2-{i}  j«J  ^ 


For  V i e K_  if  Z S.  < Z d , then  set  y ■ 1 and  set 

2 A ...  I (..  r . 1 ^ 1 1 


U {i} 

Let  (CP)  be  replaced  by  (CP|y^  = 0,  i Kq»  ^ e K^) . Solve 

(CP)  as  a transportation  problem  getting  a solution  (x,y)  . 

If  (CP)  is  infeasible,  go  to  5. 

If  v(CP)  ^ z*,  go  to  5. 

If  (x,y)  is  feasible  for  (CP),  go  to  21. 

If  v(CT)  + Z 


i:  0<y^<l 


(1  - < z*,  go  to  22. 


Solve  (LGR^)  corresponding  to  (CP)  getting  a solution  (x*,y*). 

If  v(LGR2)  2.  z*/  go  to  5. 

Calculate  penalties  P^  by  solving  (F|y^  = 1 - yp  V i £ K^. 

For  V i e K if  P.  + v(LGrS  ^ s*,  set  y.  = y?  and  set  K * = 

2 1.  2 XX  ^ X 

K * U {i}.  If  a y.  has  been  pegged  to  0 in  this  step,  go  to  19. 

^i 

Otherwise  if  a y^  has  been  pegged  to  1 add  (CP|y^  = 0,  i e K^; 
y^  = 1,  i e K^)  to  the  candidate  list  and  go  to  6.  If  no  variables 
have  pegged  to  0 or  1,  go  to  18. 

Find  i = {ilmeix  P.  } . If  there  is  a tie,  brea)c  it  arbitrarily, 
o • 1 

ieK2 

Add  the  problems  (CP|y.  = 1 - y*  ) ^Uld  (CP  |y^  = y*  ) to  the 

0^0  o o 

candidate  list.  Associate  the  value  END(CP|y.  = 1 - y*  ) * 

^o  o 
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P^  + vCLGR^)  with  (CP|y^ 

o 


1 - yj  ) ai'd  go  to  6. 
o 


19.  For  V i e K if  I S.  < Z D , set  y.  =•  1 and  set 

ftKUr  -{i}  * jeJ  J ^ 

II  {i}.  ^ 2 


20.  Replace  the  current  (CP)  by  (CP|y^  = 0,  i e K^;  y^  »=  1,  i e K^)  . 


For  V j e J let  = max  {X^  , c^  ^}.  Go  to  14. 


^2^ 


21.  An  improved  feasible  solution  has  been  found.  Set  z*  = v(CP)  cind 

reco.:d  the  associated  solution  (x,y)  as  the  new  incumbent.  Go  to  5 . 
An  improved  feasible  sedation  has  been  found.  Set  z*  » v(CP)  + 


22 


£ (1  - y,)f.  . If  0-'  y.  < 1,  set  y.  = 1,  and  record  (x,y) 

i;  0<y^<l  ^ ^ ^ ^ 


as  the  new  incumbent.  Go  to  14. 

In  step  2 ve  perform  the  continuous  knapsack  pegging  test  of 
Theorem  14  before  the  pegging  test  of  Theorem  13.  While  the  former 
test  is  weadeer  than  the  latter,  computation  time  is  generally  much 
smaller.  In  step  7 the  pegging  test  of  Theorem  14  is  used  before 
the  primary  relaxations  are  solved.  This  is  done  since  the  pegging 
test  is  independent  of  the  primary  relaxation  solution,  and  in  fact 
does  not  even  depend  on  an  incumbent  value,  z*.  Hence  if  a variable 
can  be  pegged  to  1 via  this  test,  the  primary  relaxations  will  be 
tightened.  In  step  8 a simple  conditional  feasibility  test  is  invoked. 


This  test  assumes  that  y,  is  set  to  0.  If  total  demand  cannot  be 

1 

o 


satisfied  by  opening  all  facilities  in  K - {i  },  then  y may  be  pegged 

2 o 


to  1.  In  step  9,  all  ^ ^2  substituted  out  of  (CP)  , and  the 


objective  function  and  constraints  are  modified  accordingly  (as  explained 
earlier)  . A treinsportation  or  network  algorithm  is  then  used  to  solve 


(CP)  . In  step  13,  the  fractional  y^  s in  the  transportation  solution 


are  rounded  up  (thus  assuring  integer  feasibility)  in  an  attempt  to 
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generate  an  improved  incumbent.  Of  course,  even  if  this  rounded  solution 
rosult.s  in  an  improved  incumbent,  the  current  c^mdidate  problem  is  not 


fathomed.  In  step  17  a simple  conditional  test  is  used  to  try  to  peg 
facilities  open  or  closed.  If  a facility  is  pegged  closed,  then  the 
conditional  feasibility  test  in  step  18  is  invoked,  since  by  pegging  a 
variable  to  0 this  test  is  strengthened.  Then  dual  multipliers  are 
improved  in  step  19,  and  the  Lagrange2m  relaxation  of  step  14  is  solved. 
Note  that  the  transportation  relcucation  is  bypassed  in  this  case.  This 
is  done  since,  generally,  the  transportation  relaxation  t6d(es  much 
more  computation  time  than  does  the  LagriJigean  relaxat'on.  If  no 
variables  are  pegged  to  0 or  1 in  step  17,  a branch  must  be  made.  The 
breuiching  criteria  is  to  choose  that  variable  with  the  largest  penalty, 
P^.  The  two  resulting  problems  are  placed  in  the  candidate  list  such 
that  the  most  promising  branch  is  examined  first  under  the  LIFO  rule 

A 

of  Step  6.  In  step  18  note  that  a bound  of  P.  + v(LGR^)  is  associated 

with  (CP|y,  = 1 - y*  ).  When  this  candidate  problem  is  selected 
o o 

from  the  candidate  list,  this  bound  is  coii5>ared  with  z*  to  see  if  it 
may  be  "automatically"  fathomed. 

The  test  problems  used  were  a subset  of  the  test  problems  of 
Kuehn  and  Hamburger  [1963]  and  Ellwein  [1970]  . These  problems  have 
served  as  benchmarks  for  researchers  studying  the  capacitated  facility 
location  problem.  As  previously  mentioned,  AK  have  devised  a new 
branch  and  bound  algorithm  which  has  dramatically  reduced  computation 
times  for  this  class  of  test  problems. 

We  mention  that  in  our  computer  implementation  we  have  not 
incorporated  the  results  of  Theorems  15  or  16,  and  (F)was  used  instead 
of  (F)  in  the  calculation  of  v{LGR^)  . In  Table  M,  our  results  are 


r 

compared  with  the  published  results  of  AK.  Care  should  be  taken  in 
comparing  times  for  at  least  two  reasons.  First,  different  computers 
were  used.  Second,  and  more  importantly,  different  transportation 
codes  were  used.  Since  transportation  code  time  often  accounted  for 
over  90%  of  the  total  computation  time  in  our  implementation,  a more 
realistic  comparison  would  be  the  number  of  tremsportation  problems 
solved.  In  support  of  this,  we  note  that  AK  used  an  out-of-kilter  code 
for  certain  problems  and  a primal -dual  code  for  others.  Both  of  these 
codes  had  a complete  reoptimization  capedjility.  Our  code,  on  the  other 
hemd,  had  only  a limited  reoptimization  cap^d^ility.  Specifically,  given 
am  optimal  solution  to  (CP) , reoptimization  was  only  possible  when  a 
variable  y^  was  set  to  1.  Reoptimization  was  not  possible  when  y^  was 
set  to  0.  A3  further  evidence  of  the  reoptimization  capability,  AK 
solved  a 25  facility  by  50  customer  problem  using  the  test  of  Theorem 
14,  amd  maOdng  one  branch  in  about  .2  seconds.  With  our  transportation 
code  these  saune  computations  took  over  5 seconds.  Generally,  we 
observed  that  for  easy  problems  (15  or  less  transportation  problems 
solved)  the  results  were  quite  similar.  However  for  more  difficult 
problems,  our  algorithm  generally  required  the  solution  to  fewer 
transportation  problems. 

B.  An  Interactive  Approach  for  the  Parametric  Capacitated  Facility 
Location  Problem 

In  this  section  we  consider  the  general  parametric  capacitated 
facility  location  problem,  7).  The  approach  which  we  shall  propose 
applies  generally  to  7)  , however,  the  test  problems  which  we  have  studied 
vary  only  one  of  the  possible  parameters  at  a time.  Specifically,  we 
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have  tested  problems  with  varying  demand  only,  varying  fixed  costs 


only,  amd  varying  tr2Lnsportatlon  costs  (c^^)  only.  Because  of  the 
computer  cost  involved  in  solving  capacitated  facility  location 
problems,  we  chose  not  to  run  test  problems  for  the  continuous  parcuneter 
izations  in  the  objective  function  euid  in  the  right  hwd  side. 

The  plan  of  this  section  is  to  investigate  the  problem  dependent 
techniques  of  chapter  III,  and  the  factors  affecting  the  scheduling 
of  solution  priorities  in  chapter  IV.  Then  an  interactive  approach  for 
solving  7)  is  proposed,  and  computational  experience  is  cittd. 

Reduction  techniques  for  7)  can  be  quite  effective.  The  pegging 
tests  of  Theorems  13  and  14  should  be  used  for  each  (Pj^)  . Note  that 
if  a parameterization  involves  only  the  fixed  costs,  then  both  pegging 
test  calculations  need  only  be  done  once.  This  follows  since  the 
calculations  remain  the  same,  regardless  of  the  value  of  the  fixed 
costs.  All  that  must  be  done  is  to  coiqjare  the  calculated  figure  with 
the  fixed  cost  for  each  k = 1,...,K.  For  other  parameterizations  the 
test  of  Theorem  14  may  be  done  separately  for  each  k = 1,...,K,  since 
all  that  is  involved  is  the  solution  of  a continuous  knapsack  for  each 
facility  i for  each  k = 1,...,K.  The  test  of  Theorem  13,  on  the  other 
hand,  involves  solving  a transportation  problem  for  each  facility  i 
for  each  k = 1,...,K.  In  order  to  take  advantage  of  efficient  reop- 
timization techniques  for  this  test  one  could  solve  the  K transportation 
problems  for  y^,  say,  as  a group,  reoptimizing  the  optimal  tableau  from 
k = 1 for  k = 2,  etc.  This  reoptimzation  may  reduce  total  computation 
time  for  this  test.  Naturally,  the  results  of  Theorems  15  and  16  may 
also  be  used  for  each  k = 1,...,K.  In  both  cases  the  computational 
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burden  is  light,  even  when  repeated  K times. 

Feasibility  recovery  techniques  have  turned  out  to  be  very 
important  for  this  class  of  problems.  In  fact  for  about  one  half  of  the 
parameterizations  tested,  the  feasibility  recovery  technique  found  an 
optimal  solution  for  the  next  problem  in  the  parameterization.  With 
the  use  of  thj.-^  solution  value  as  an  upper  bound,  it  was  possible  to 
terminate  the  branch  and  bound  search  without  any  bremching  whatsoever! 

We  shall  explain  this  behavior  in  detail  later.  Clearly,  if  the 
parauneterization  involves  only  the  objective  function,  there  are  at 
least  two  methods  for  generating  a feasible  solution  for  (P^)  from 
an  optimal  solution,  (x*  ,y*)  ^ to  (P^^) . First,  since  (x*,y*)^  is  feasible 
in  (P2) , we  may  siitply  cost  out  that  solution  using  the  objective 
function  for  (P^) . Second,  by  using  an  optimal  design  of  facilities 
for  (Pj^) , we  may  solve  the  associated  transportation  problem  with  the 
objective  function  for  (P^) . This  latter  method  was  used  in  our  computer 
implementation.  If  the  parameterization  involves  the  right  hand  side 
and  (x*,y*)j^  remains  feasible  for  (P2) , one  may  also  solve  the  associated 
transportation  problem  using  the  optimal  design  of  facilities  for  (P^^). 

If  (x*,y*)^  is  not  feasible  in  (P2) » then  one  may,  for  example, 
selectively  open  enough  facilities  in  addition  to  the  open  facilities 
in  the  optimal  solution  to  (P^)  until  feasibility  is  assured,  i.e. 

i S.  ^ i Dj  . Then  the  associated  transportation  problem  can 
i:y^=l  ^ jeJ 

be  solved. 

Bounding  problem  reoptimization  techniques  cam  also  be  very 
important.  In  general  at  a fathomed  node  for  (P^^)  , one  could  tadte  the 
optimal  1 .ansportation  tableau  aind  use  it  as  a starting  tableau  for 
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[ optimizing  the  corresponding  candidate  problem  for  (P^) . If  an  inter- 

t 

\ active  procedure  is  used«  one  could  store  the  optimal  tableau  for  the 

f Ccindidate  problem  on  disk  or  tape,  and  then  read  t'lis  information  back 

into  core  when  the  candidate  problem  for  (P^)  at  that  node  is  considered. 

Finally,  wide  r2mge  bounding  techniques  may  be  ejt^loyed  at  a given 

node.  There  are  at  least  two  possibilities.  First  (LGR^)  may  be  solved 

for  (P^)  using  the  A from  the  tr^ul8portation  problem  solved  at  the  node 

for  (P^) . Second,  all  constraints  could  be  absorbed  into  the  objective 

function  using  the  appropriate  dual  multipliers  from  the  trwsportation 

problem  solved  for  (P^^)  at  the  node.  However,  since  both  of  these 

relaxations  are  of  moderate  computational  expense,  the  former  approach 

(which  is  stronger)  should  probably  be  used. 

We  now  turn  to  the  factors  affecting  the  scheduling  of  solution 

priorities.  Tightness  of  the  primary  relaxation  for  a given  (P^^)  has 

been  found  to  be  dependent  on  one  main  characteristic.  We  assume  for 

this  analysis  that  the  ratios  equal  for  V i e I.  Let  (x,y) 

be  an  optimal  solution  for  (P,).  If  I f.y.  is  "close"  to  E f.y^, 

K ._XX  '.iX 

lel  lel 

where  (x*,y*)  Js  an  optimal  solution  to  » then  the  relaxation 

will  be  relatively  tight.  Conversely,  if  E f.y.  is  much  smaller 

iel 

than  E f.y*,  then  the  relaxation  will  be  relatively  loose.  Now  if 
iel  ^ 

fixed  costs  are  relatively  high  with  respect  to  transportation  costs, 
then  facilities  which  are  open  in  y*  will  probably  be  operated  close 
to  their  upper  capacities.  The  corresponding  relaxation  will  probably 
be  tight.  If,  on  the  other  hcind,  fixed  costs  are  relatively  low  with 
respect  to  trcinsportation  costs,  then  facilities  which  are  open  in  y* 
will  probably  be  operated  at  something  less  than  their  upper  capacity. 
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In  this  case  the  continuous  rel^u(ation  will  probably  be  looser.  Still 
another  way  to  look  at  relaxation  tightness  is  the  difference  between 


T.  S.y*  and  I S.y, 

• , i i 4 T 1-1 

icl  id 


Z 0 . This  difference  is  m2mifested  costwise 

jcJ  ^ 


in  the  difference  between  L f y*  and  Z f.y  . By  using  these 

id  ^ ^ id  ^ 

intuitive  relationships,  one  can  often  "predict"  the  tightness  of  the 
continuous  relaxation  as  a function  of  the  parameterization.  We  h ve 
the  following  relationships: 


Type  of  parameterization 


increase 

increase  f.'s 
1 

increase  S.'s 
1 


Tendency  of  continuous  relaxation 

tighten 

loosen 


I D.  is  small; 
jeJ  3 


increase  D . ' s 
D 


loosen  if  Z S.y* 
id  ^ ^ 

tighten  if  large 

loosen  if  Z S.y?  - Z D.  is  small; 

iel  ^ ^ jej  3 
tighten  if  large 

Note  that  these  relationships  are  also  dependent  on  the  relative 
importance  of  transportation  costs  which  in  turn  are  affected  by  the 
number  of  facilities  which  are  open  in  an  optimal  solution.  Thus  total 
transportation  cost  is  higher  if  fixed  costs  are  high,  since  this 
implies  that  fewer  facilities  are  open  in  an  optimal  solution.  So 
we  see  that  the  tr£msportation  costs  have  an  effect  opposit*  that  of 
fixed  costs  on  the  tightness  of  the  relaxation.  This  is  reflected  in 
the  display  above. 

The  behavior  of  individual  facilities  in  an  optimal  solution  as  a 
function  of  certain  parameterizations  is  closely  related  to  the  analysis 
above.  For  excunple,  suppose  all  fixed  costs  rise  by  the  same  amount. 
This  has  the  qualitative  effect  of  making  the  opening  of  each  facility 
less  attractive.  Coiipled  with  the  fact  that  the  total  trcuisportation 
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cofjt  for  .viy  qiven  facility  design  remains  the  same  for  both  sets  of 
fixed  costs,  it  is  easy  to  see  that  this  rise  in  fixed  costs  is 
equivalent  to  tightening  an  ispliclt  constraint  on  the  number  of  open 
facilities  in  an  optimal  solution.  Similarly  if  demands  rise,  then 
one  would  expect  additional  facilities  to  be  opened.  A rise  in 
trajisportation  costs  would  be  accompcuiied  by  a tendency  toward  opening 
more  facilities  aliio.  Of  course  for  certain  "local"  parameterizaf  ons, 
such  as  an  increase  in  one  fixed  cost  or  an  increase  in  certain 
transportation  costs,  tendencies  of  specific  vari^d5les  can  be  identified 
more  precisely. 


The  persistence  of  scratch  trees  for  the  parameterizations  which 
we  tested  was  generally  very  good.  Such  behavior  would  seem  to  be 
plausible  when  one  considers  the  size  of  the  decision  space  for  our 


test  problems.  The  number  of  facilities  considered  rcuiged  from  10  to 
25,  while  the  number  of  continuous  variables  rariged  from  200  to  1250. 
with  a decision  space  of  dimension  25  or  less,  emd  the  empirical  obser- 
vation that  the  majority  of  facilities  are  "inportemt" , it  seems  plaus- 
ible that  they  remain  "important"  for  most  parameterizations  of  interest. 
If  this  is  the  case,  scratch  trees  should  be  rather  stable  since  "impor- 
tant" variables  are  branched  on  first  in  our  algorithm.  This  has  been 
borne  out  empirically,  and  indeed  this  bodes  well  for  using  a serial 
approach  with  an  initial  separation  gleaned  from  the  previous  (P^^)  . 

'We  sb:ill  now  present  a method  for  solving  problem  7)  . Due  to 
tlie  relatively  high  computer  cost  for  solution  of  reasonable  sized 
problems,  we  chose  an  interactive  approach.  That  is,  (P^)  was  solved 
to  optimality  in  one  computer  run,  and  then  using  information  from 
this  computer  run,  another  r'ln  was  made  to  solve  (P2^  * using  this 
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interactive  approach,  closer  control  over  computation  time  was  possible, 
and  a freer  hand  in  experimentation  was  permitted. 

Algorithm  J : 

1.  Set  k - 1.  Solve  (P^)  by  Algorithm  1 getting  w optimal  solution, 

2.  If  k > K,  stop.  If  (Pj^)  and  are  relatively  monotone,  if 

their  objective  lurctions  are  identical,  and  if  (x*,y*)j^  e ^^^k+1^  ' 
then  (x*,y*)j^  is  optimal  in  » so  k ■ k + 1,  and  retur. 

to  the  beginning  of  this  step. 

3.  Set  k ■ k + 1.  If  k > K,  stop. 

4.  Use  a feasibility  recovery  technique  on  to  find  a good 

feasible  solution  for  (Pj^)  • Call  it  (x*,y*)j^  cmd  its  corresponding 

value  z*. 
k 

5.  Invoke  Algorithm  I for  (Pj^)  with  the  following  modifications: 

a)  replace  step  19  by;  "store  the  current  index  sets  K^,  K^,  K^, 
the  incumbent  (x*,y*)  , and  z*,  and  return  to  step  6 of 

It  It 

Algorithm  J. " 

b)  replace  step  5 by:  "stop  if  the  candidate  list  is  empty;  if 
there  e;-;’sts  an  incumbent  ;.t  is  optimal  in  (Pj^)  » return  to 
step  2 of  Algorithm  J." 

6.  Use  some  modification  of  the  branch  and  bound  tree  for  (P,  ,)  to 

k-1 

form  am  initial  separation  for  (P^^) . Put  this  initieil  separation 
in  the  form  of  a candidate  list,  and  go  to  step  6 of  Algorithm  I. 
When  the  stop  condition  in  step  5 of  Algorithm  I is  satisfied,  go 
to  step  2 of  Algorithm  J. 

In  step  2,  since  7)  is  a general  parairietric  problem,  we  require 
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identical  objective  functions.  However,  this  can  be  relaxed  for  certain 

objective  function  changes.  In  step  4 the  particular  feasibility 

recovery  technique  will  depend  on  the  type  of  parameterization.  In 

step  5 a modification  of  Algorithm  I is  used  in  order  to  perform  the 

pegging  tests  of  Theorems  13  and  14,  and  other  pegging  tests  based  on 

the  Lagremgean  relaucation  (LGR^)  for  (Pj^) . This  procedure  continues 

until  either  fathoming  occurs  (in  which  case  (P^^)  has  been  solved) , or 

until  a point  is  reached  where  no  more  pegs  cam  be  made.  When  no  more 

pegs  can  be  made,  control  passes  to  step  6 of  Algorithm  J.  In  step  6 

an  initial  separation  based  on  the  bramch  i ^d  bound  tree  of  is 

generated.  The  reasoning  behind  this  approach  is  as  follows. 

Generally,  the  pegging  tests  of  Theorems  13  amd  14  are  quite 

effective  in  :)C'gging  facilities  open  at  the  root  node.  Hence  these 

te^ts  < re  Jerformed  for  each  (P.  ) in  order  to  reduce  the  number  of 

k 

frf.e  facilities  in  the  problem,  amd  hopeful lly  to  reduce  the  number 

o'  branches  made  during  the  branch  and  bound  process,  a modification 

of  branch  and  bound  tree  for  (P,  ,)  is  used  to  form  an  initial 

k-1 

separation  because  of  the  pegging  procedure  in  step  5.  The  modification 
CcUi  best  b<;  explained  by  referring  to  a typical  branch  and  bound  tree 
for  (P^)  (see  figure  below) . 


Branch  and  bound  tree  for  (P^)  Frontier  of  fathomed  nodes  for  (P^) 

(denoted  by  • ) 
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Note  that  vertical  lines  refer  to  pegged  variables.  That  is, 
the  opposite  bremch  is  automatically  fathomed.  It  is  imjMrteuit  to 
realize,  however,  that  these  opposite  branches  are  part  of  the  frontier 
of  fathomed  nodes  as  depicted  in  the  figure  above.  If  this  full  frontier 
were  used  as  eui  initial  separation  for  (P^) , the  number  of  problems  in 
the  initial  candidate  list  would  be  13.  However  by  "collapsing  out" 
the  pegged  variables  from  the  tree,  we  may  reduce  the  frontier  to  4. 

See  the  figure  below. 


'b-”  .0: 


o ''3“ 


"Collapsed"  branch  and  Frontier  of  fathomed 

bound  tree  for  (P^^)  nodes  for  "evllapsed" 

tree  (denoted  by  • ) 

While  such  a manipulation  may  appear  contrived,  we  offer  the 
following  expl2mation.  In  the  sericU.  approach,  which  uses  the  frontier 
of  fathomed  nodes,  there  is  an  underlying  supposition.  It  is  that  in 
a branch  and  bound  tree  if  a node  cannot  be  fathomed  for  say,  (P^^)  , 
then  it  probably  cannot  be  fathomed  for  a closely  related  problem, 
say,  C?^),  Conversely,  if  a node  is  fathomed  for  (P^)  , then  it  likely 
will  be  fathomed  for  (P^)  also.  A variable  which  is  pegged  to  a 
certain  value  cam  be  thought  of  in  an  amalogous  manner.  If  y^  can  be 
pegged  to  1 in  (P^)  at  a given  node,  then  it  can  probadsly  be  pegged  to 
1 in  (P^)  also  at  that  given  node.  Hence,  instead  of  considering  the 
full  frontier  of  fathomed  nodes  for  (P^^),  we  may  eliminate  the  pegs 
from  the  tree,  and  attempt  to  peg  variables  at  the  root  node  of  (P^)  as 
in  step  5 of  Algorithm  J. 
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We  note  that  other  methods  for  reducing  the  frontier  of  fathomed 
nodes, while  still  maintaining  a "good"  Initial  separation,  are  possible. 
However,  we  shall  defer  discussion  of  them  to  chapter  VIII. 

As  a final  comment  on  Algorithm  J,  we  submit  that  the  ordering  of 
the  initial  ceindidate  list  in  step  6 can  be  very  important.  We  present 
three  orderings  which  have  proven  to  be  effective: 

a)  Order  the  cemdidate  problems  by  the  inverse  ordijr  in  which 
they  were  fathomed  for  the  previous  problem.  That  is,  the 
candidate  problem  fathomed  first  is  placed  at  the  end  of  the 
list,  so  that  under  a LIFO  rule,  it  will  be  examined  first. 

b)  Order  the  candidate  problems  in  decreasing  order  of  their 
relaxation  values  for  the  previous  problem.  Thus,  under  a 
LIFO  rule  the  most  promising  candidate  problem  will  be 
examined  first. 

c)  Modify  the  ordering  in  a)  or  b)  by  placing  last  in  the  list 
the  Ccuididate  problem  at  which  an  optimal  solution  for  the 
previous  problem  was  found. 

In  our  computational  studies,  ordering  b)  coupled  with  modification  c) 
was  generally  the  best  of  these  orderings. 

Test  problems  were  taken  from  the  problems  in  Table  M.  For 
example,  problems  1,  2,  3,  and  4 differ  only  in  fixed  costs,  as  do  6, 

7,  8,  and  9,  and  16,  17,  18,  and  19.  Other  problems  were  generated  by 
increasing  all  customer  demands  by  some  percentage  (i.e.  + 5%),  while 

still  others  were  generated  by  increasing  all  transportation  costs  by 
some  percentage  (i.e.  c^^  + 10%).  Algorithm  J was  compared  with  a 
traditional  approach  vdiich  follows. 
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Algorithm  K; 


1.  Set  k ■ 1. 

2.  Solve  (P  ) by  Algorithm  I getting  an  optimal  solution  (x*,y*)  . 

k k 

3.  Set  k-k-fl.  Ifk>  K,  stop. 

4.  Use  a feasibility  recovery  technique  on  (x*,y*)j^  to  find  a good 
feasible  solution  for  (P  ) . Call  it  (x*,y*).  and  its  corresponding 
objective  value  z*.  Go  to  2. 

A comparison  of  the  two  algorithms  is  given  in  Table  N.  Note  that 
the  computation  time  includes  the  time  for  the  'ilieorem  13  pegging  tests, 
but  that  the  number  of  transportation  problems  solved  does  not  include 
the  (|l|  i)  tr^msportation  problems  solved  for  this  pegging  test.  We 
mention  that  the  computation  time  for  this  test  is  much  higher  than  it 
would  be  if  a reoptimization  capability  were  available  in  our  trans- 
portation code.  Because  of  this  shortcoming,  the  savings  realized 
by  Algorithm  J over  Algorithm  K are  reduced.  Note  that  in  4 of  the  8 
parameterizations  tested,  only  one  transportation  problem  was  required 
to  solve  each  problem  after  (P^^)  . This  was  due  to  the  fact  that  the 
solution  generated  by  the  feasibility  recovery  technique  was  an 
optimal  solution,  and  that  the  Lagrangean  relaxation  penalties  were  so 
strong  that  many  of  the  remaining  free  facilities  were  pegged  open  or 
closed.  Then  after  these  pegs  were  made,  the  corresponding  Lagrangean 
relaxation  value  bounded  out. 

In  conclusion,  we  see  that  Algorithm  J dominates  Algorithm  K.  For 
various  reasons  mentioned  throughout  this  chapter,  it  is  reasonable  to 
assume  that  this  domination  Ccui  only  become  more  pronounced  as  more 
difficult  problems  are  solved. 
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VIII.  EXTENSIONS  TO  THE  GENERAL  PILP  AND  AREAS  FOR  FUTURE  RESEARCH 


A.  A Solution  Method  for  the  General  PILP 

In  the  preceding  three  chapters  we  have  analyzed  PILPs  for  special 
problem  classes.  In  this  section  we  extend  what  we  have  learned  to 
the  genered  PILP: 

0)  For  k ■ 1,...,K  solve: 


min  (c  + f,  )x 
k 

(A  + Dj^)x  ^ b + rj^ 
Xj  integer,  j e J 


I 


i 

f 

I- 

I 


r 

I 


V 

s 


where  fj^,  and  r^^  are  conformable  with  c.  A,  amd  b respectively. 

Cur  goal  is . to  give  prescriptions  for  solving  the  PILP  in  an 
efficient  manner.  In  chapter  IV,  three  solution  priorities  were 
outlined:  serial,  lexicographically  serial,  and  parallel.  The  reader 
will  recall  that  only  the  first  two  priorities  were  considered  in  our 
coit5)utational  studies,  since  the  parallel  approach  seems  to  be  dom- 
inated by  both  of  the  other  approaches.  In  this  chapter  we  shall 
reduce  consideration  to  only  one  approach,  namely,  the  serial. 

The  lexicographically  serial  approach  (l.s.a.)  has  one  inherent 
weakness,  it  is  that  individual  (Pj^)  are  not  solved  to  optimality  in 
any  preordained  order.  For  the  analyst  who  must  solve  the  generc'l  PILP, 
this  could  be  disastrous,  given  a limited  computer  budget.  In  the 
l.s.a.  there  is  no  way  to  monitor  or  control  the  amount  of  computer 
time  spent  on  a particular  (P^^) . In  fact,  after  an  inordinate  amount 
of  computer  time  has  been  used,  it  is  possible  that  only  minimal 
progress  may  have  been  realized  in  the  solution  of  each  (P^^)  . 


i 

i 
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Furthermore,  we  point  out  that  the  primary  advantages  of  the  l.s.a. 
can  be  overcome  by  clever  implementation  of  a serial  approach.  Two 
adv^ultages  of  the  l.s.a.  are  the  small  amount  of  bookkeeping  calculations 
iid  core  storage  required.  However,  for  more  difficult  PILPs,  the 
bookkeeping  time  becomes  insignificant,  since  the  time  required  for 
solving  the  primary  relaxation  at  each  node  generally  is  the  lion's 
share  of  total  computation  time.  This  was  manifested  in  the  facility 
location  problem  of  chapter  VII,  where  over  90%  of  total  computation 
time  was  devoted  to  the  solution  of  transportation  problems  only.  For 
more  difficult  problems,  computer  core  limitations  impose  serious 
restraints  on  the  serial  approach.  This  is  avoided  in  the  l.s.a.. 

However  by  using  cui  interactive  serial  approach  (i.s.a.)  as  outlined 
in  d -.er  VII,  node  information  is  stored  either  on  high  speed  disk 
or  tape,  and  hence  the  core  storage  problem  is  alleviated.  A third 
advantage  of  l.s.a.  is  the  reoptimization  capcibility  from  problem  to 
problem  in  the  PILP.  That  is,  at  a given  node  the  optimal  bounding 
problem  releixation  solution  for  say,  (CP^),  is  used  as  a starting 
point  for  the  solution  of  the  relaxation  for  (CP^).  Oftentimes  this 
reoptimization  technique  can  realize  significant  savings  in  computation 
time.  This  scheme  may  be  used  in  the  serial  approach  as  well,  by 
simply  storing  the  optimal  basis  (when  LP  is  used  as  the  primary  relax- 
ation) for  the  relaxation  of  (CP^)  on  disk  or  tape.  Then,  when  the 
relaxation  of  (CP^)  is  to  be  solved,  the  corresponding  basis  can  be 
retrieved  and  used  as  the  starting  basis.  Of  course  this  retrieval 
incurs  a setup  time,  but  as  pointed  out  earlier,  setup  time  is 
insignificant  for  more  difficult  problems.  Thus,  the  advantages  of 
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of  the  l.s.a.  can  be  neutralized  by  judicious  use  of  an  i.s.a.. 

We  now  analyze  the  i.s.a.,  and  point  out  the  more  importeint 
factors  in  the  implementation  of  such  a method.  By  incorporating  the 
hum£in  factor  into  the  process,  not  only  is  closer  control  in  monitoring 
the  computation  process  possible,  but  greater  flexibility  in  solution 
strategies  can  be  realized.  An  i.s.a.  allows  the  emalyst  to  gleeui 
information  from  the  solution  process  for  (P^^)  in  order  to  solve  (P^) 
more  efficiently.  There  are  at  least  four  sources  of  this  information. 
They  are: 

• an  optimal  solution  for  (P^ ) 

• root  node  penalties  and  a branch  and  bound  tree  for  (P^^) 

• success  of  branching  criteria  in  the  branch  and  bound  tree 

• relative  effectiveness  of  various  fathoming  tests. 

Each  of  these  sources  can  be  most  helpful  in  pleuining  a solution 
strategy  for  (P^) . In  the  following  few  paragraphs  we  shall  analyze 
each  of  these  sources. 

Various  feasibility  recovery  techniques  have  been  presented  for 
the  special  problem  classes  of  chapters  V,VI,  and  VII.  For  the  general 
PILP,  such  technic[ues  may  or  may  not  apply,  depending  on  the  type  of 
parameterization.  Therefore  in  order  to  be  assured  of  flexibility  in 
the  feasibility  recovery  technique,  it  may  be  advisable  to  have  the 
analyst  apply  ad  hoc  techniques  for  obtaining  a feasible  solution  to 
(P^)  from  an  optimal  (or  just  feasible)  solution  to  (P^^)  . Such 
techniques,  of  course,  can  be  coupled  with  a computerized  optimization 
scheme,  for  example,  where  all  integer  variables  are  fixed  to  a specific 
value. 
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The  root  node  penalties  and  the  brimch  emd  bound  tree  generated  in 
solving  (P^)  can  be  used  as  a guide  In  generating  an  Initial  separation 
for  (^2^  * first,  consider  the  penalties  generated  at  the  root  node  for 
(P^) . Such  penalties  are  generally  calculated  In  order  to  choose 
branch  variables.  They  may  be  LP  based,  or  they  may  be  a by-product 
of  a Lagrangean  relaxation.  Lagrangean  penalties  can  be 
quite  a bit  stronger,  and  at  the  same  time  require  fewer  calculations 
(Geoffrlon  [1973]).  By  ran)clng  the  absolute  values  of  these  penalties 
in  descending  order,  one  can  get  some  feeling  for  the  "important?"  of 
the  Individual  Integer  variables.  Such  a ranking  is  valu2d3le  since  in 
a branch  2md  bound  process  It  Is  prefereible  to  breuich  on  variables 
which  have  large  penalties,  early  in  the  branching  scheme.  After  (P^) 
has  been  solved  and  the  root  node  penalties  have  been  ordered  for  (P^)  , 
the  root  node  penalties  for  (P^)  are  calculated  cuid  ordered  also.  By 
cooparlng  the  orderings  for  (P^)  amd  (P^)*  one  can  get  some  Indication 
of  whether  the  "important"  variables  in  (Pj^)  are  "important"  in  (P^) 
also.  If  this  Is  the  case,  it  is  reasonad^le  to  assume  that  the  branch 
and  bound  tree  for  (P^^)  will  generate  a "good"  initial  separation  for 
(P2) . If,  on  the  other  hand,  the  orderings  are  quite  different,  the 
branch  and  bound  tree  for  (P^)  may  generate  a relatively  poor  initial 
separation  for  (P2)  • In  this  case  it  may  be  better  to  either  solve 
(P2)  with  no  initial  separation,  or  to  use  some  separation  based  on 
the  root  node  penalties  for  (P2)  with  little  or  no  input  from  the  (Pj^) 
solution  process. 

Considering  the  case  where  the  root  node  penalty  orderings  are 
reasonably  correlated,  a number  of  possible  choices  exist  for  the 
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generation  of  initial  separation.  The  simplest,  of  course,  is  to 
use  the  frontier  of  fathomed  nodes  from  the  brauich  and  bound  tree  for 
(P^)  . However,  as  we  have  seen  in  chapters  V and  VII  such  a separation 
may  be  rather  large.  A nimber  of  modifications  can  be  made  which 
reduce  the  size  of  the  initial  separation,  while  still  retaining  the 
power  of  the  separation.  First,  varieibles  which  were  pegged  to  a 
specific  value  cam  be  "collapsed  out"  of  the  tree  (cf.  chapter  VII. B). 
Second,  branches  which  would  not  have  been  made  if  the  optimal  solution 
to  (P^)  had  been  known  at  the  beginning  of  the  solution  process  cam  be 
eliminated.  These  additional  branches  can  occur  if  the  optimal 
solution  value  for  (P^)  was  not  found  until  late  in  the  bremching 
process.  In  this  case,  the  additional  branches  were  made  because  the 
fathoming  by  value  test  used  an  inferior  incumbent  value.  Selected 
branches  may  also  be  eliminated  if  the  parent  node  of  tJie  branches  had 
a relaxation  value  "close"  to  the  optimal  solution  value  for  (P^^)  . 

Thus  the  node  was  "almost"  fathomed,  but  since  it  just  missed  being 
fathomed,  a branch  had  to  be  made.  Since  our  general  supposition  in 
the  serial  method  is  that  if  a node  is  fathomed  for  (P^)  , it  will 
probably  be  fathomed  for  (P^l  as  well,  we  see  that  it  is  reasonable  to 
include  nodes  which  are  "almost"  fathomed  in  our  collection  (and  to 
eliminate  the  successor  nodes  of  these  nodes  from  the  collection). 

Still  another  method  for  'educing  the  size  of  the  initial  separation 
is  to  use  only  those  branches  which  are  on  the  optimal  path.  That  is, 
the  path  from  the  root  node  to  the  node  where  the  optimal  solution 
was  found.  See  figuie  below. 
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Branch  and  bound  tree  for  (P^)  Initial  separation  using 

the  optimal  path  only 

For  the  case  where  the  root  node  penalty  orderings  for  (P^)  and 
(P^)  are  not  well  correlated,  2uiother  Initial  separation  based  on  the 
(P^)  root  node  penalties  ceui  be  generated.  Specifically,  we  may  commit 
a number  of  variables  as  br£mch  variables  using  the  (P^)  penalty 
ordering.  See  figure  below. 

0 

0 

0 0 

Initial  separation  for  (P^) 
using  root  node  penalty  ordering 

In  this  case  the  left  hand  branch  constrains  Uie  variable  to  its 

"favoredsle"  value  as  deduced  from  the  penalties.  The  variable  with 

the  largest  edssolute  penalty  is  committed  first,  the  second  largest 

second,  etc. 

The  relative  effectiveness  of  breuiching  criteria  for  (P^)  may  be 
used  in  formulating  the  branching  criteria  for  (P^)  • A measure  of 
the  effectiveness  of  a branching  criterion  is  the  number  of  "mistakes" 
made  in  the  breuich  and  bound  process.  A "mistake"  is  defined  to  be 
investigation  of  the  ■ 1 branch  first, say,  when  the  * 0 branch 
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contains  an  optimal  solution  for  (P^^)  . That  is,  the  branching  criterion 
indicates  that  the  ■ 1 br^ulch  is  preferred  over  the  = 0 branch, 
when  in  fact  the  x^  = 0 branch  contains  an  optimal  solution.  By 
keeping  track  of  the  mistakes  'n  a branch  and  bound  tree,  one  can 
identify  a threshold  penalty  value  below  which  the  branching  criterion 
may  no  longer  be  reliable.  Furthermore  it  may  be  possible  to  identify 
specific  varieJoles  for  which  the  breuiching  criterion  is  unreliable. 

By  categorizing  variables  according  to  their  penalty  indicators  for 
(Pj^)  and  (P^)  as  well  as  according  to  the  anticipated  effect  of  the 
parameterization  on  each  variable,  one  can  "predict"  the  relieibility 
of  the  (P^)  penalty  indicator  for  each  variable.  The  following  display 
delineates  the  possible  cases.  In  using  this  display,  we  assume  that 
an  optimal  solution  to  (P^^)  has  been  found,  that  the  root  ncde  penalties 
have  been  calculated  for  (P^^)  and  (P^)  , and  that  an  intuiti\e  analysis 
has  been  made  concerning  the  effect  of  the  parameterization  on  each 


variable.  Further  we  assume  that  all  integer  variables  are  0-1. 


Penalty  Indicator 

Penalty  Indicator 

Reliability  of  Penalty 

for  (P^) 

for  (P^) 

Indicator  for  (P„) 

• indicator  agrees 
with  optimal  solution 
value  in  (P^) 

indicator  agrees 
with  penalty  indi- 
cator for  (P^) 

a)  very  reliable  if 
param.  tends  to  keep 
variable  at  same  value 

b)  reliable  if  opposite 
of  a) 

• indicator  agrees 
with  optimal  solution 
value  in  (P^^) 

indicator  disagrees 
with  penalty  indi- 
cator for  (P^) 

c)  uncertain  but  tending 
to  be  relicible  if  param. 
tends  to  change  value 

of  variable 

d)  very  uncertain  if 
opposite  of  c) 

• indicator  disagrees 
with  optimal  solution 
value  in  (P^) 

indicator  agrees 
with  penalty  indi- 
cator for  (Pj^) 

e)  uncertain  but  tending 
to  be  reliable  if  param. 
tends  to  change  value 
of  variable 

f)  very  uncertain  if 
opposite  of  e) 

134 


^ • indicator  disagrees  indicator  disagrees  g)  uncertain  but  tending 

i with  optimal  solution  with  penalty  indi-  to  be  reliable  if  param. 

value  in  (P^)  cator  for  (P^^)  tends  to  keep  variable 

\ at  same  value 

h)  very  uncertain  if 
opposite  of  g) 

By  categorizing  each  variable  by  its  reliability,  one  is  able  to 
modify  the  branching  criterion  in  at  least  two  ways.  First,  a threshold 
for  variables  can  be  established,  below  which  varieibles  should  be  chosen 
for  branching  by  some  other  criterion.  Second,  if  a reliable  variable 
and  an  uncertain  variable  are  being  considered  for  becoming  the  next 
branch  variable,  the  reliable  variable  should  always  be  chosen.  Thus 
it  is  possible  to  modify  branching  criteria  through  the  use  of  root 
node  penalty  indicators  for  (P^)  and  (P^) , as  well  as  by  intuitive 
tendencies  deduced  from  the  type  of  parameterization. 

The  fourth  source  of  information  for  meiking  the  (P^)  solution 
process  more  efficient  is  the  effectiveness  of  various  fathoming  tests. 
For  exeuiple,  if  some  conditional  logical  tests  were  ineffective  for 
(P^) , then  one  might  consider  the  elimination  of  such  tests  for  (P^)  . 
Similarly,  if  calculations  which  attempt  to  tighten  the  primai^^ 
relcixation  generally  fail  for  (P^) , they  might  be  eliminated  for  (P^) . 

In  conclusion,  the  i.s.a.  is  a very  flexible  approach  which 
allows  the  analyst  to  modify  solution  techniques  in  such  a way  that 
the  experience  glecmed  in  solving  (P^)  is  used  to  maximxjm  advantage 
in  the  solution  procedure  for  (P^)  . 

B.  Future  Research 

In  this  section  we  give  a brief  outline  of  topics  in  the  PILP 
area  which  are  fertile  for  further  research. 
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One  such  area  is  the  study  of  the  optimal  solution  as  a function 


of  a specific  parameterization.  We  have  alluded  to  this  in  chapters 
II  and  III.  Hopefully,  stronqer  and  more  useful  results  can  be  devel- 
oped for  other  problem  classes  which  take  advantage  of  the  knowledge  of 
em  optimal  solution  for  one  problem  in  order  to  solve  a closely  related 
problem.  Such  properties  as  continuity,  monotonocity,  and  convexity  of 
the  optimal  solution  (possibly  in  certain  components)  and  of  the  optimal 
solution  value  would  seem  to  be  worth  seeking. 

Still  another  area  is  the  use  of  other  methods  such  as  cutting 
planes  and  group  theory  either  alone  or  in  conjunction  with  a branch 
and  bound  approach.  We  have  outlined  a rudimentary  cutting  plane 
approach  in  chapter  I.  It  may  be  that  such  an  approach  would  be  quite 
effective.  More  premising,  however,  might  be  the  incorporation  of  a 
cutting  plane  capability  in  a branch  and  bound  scheme. 

Third,  a parametric  capability  must  be  designed  for  use  in  coniner- 
cial  IliP  codes.  An  interactive  serial  method  as  outlined  in  section  a 
of  this  chapter  would  seem  to  permit  relatively  simple  and  inexpens.ve 
implementation . 

Fourth,  it  would  seem  likely  that  the  solution  method  of  chapter 
V.D  can  be  extended  to  certain  nonlinear  parameterizations  where  the 
optimal  objective  value  is  a concave  (for  minimization)  function  of  0. 

Fifth,  we  note  that  techniques  for  parallelizing  computations 
would  be  most  effective  in  a PILP  context.  Such  an  approach  would  rely 
on  the  implementation  of  specific  computer  data  structures.  Further- 
more, the  advent  of  fourth  generation  computers  such  as  ILLIAC  IV  which 
performs  computations  in  parallel  should  also  have  a telling  impact  on 
PILP  algorithms. 
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In  conclusion,  we  surmise  that  parametric  methods  in  integer  pro- 
<><anininq  will  assume  greater  importance  as  ILP  solution  methods  improve 
Just  as  in  LP,  where  parametric  analysis  has  become  an  expected  and 
useful  part  of  most  solution  studies,  we  ejqpect  the  same  to  occur  in 
ILP.  We  acknowledge  that  our  study  of  PILP  is  just  a beginning.  The 
true  test  of  a method  lies  in  its  use  by  those  who  can  benefit  by  its 
availability. 
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